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p. xxix At the end of the first paragraph, insert the sentence: 
"These findings are not unique to this study but have been reported 
previously by several other researchers." 

p. xxxv The second complete paragraph, first sentence, should 
read: "As pointed out by others, using the SAT scores " 

p. xxxvii The first sentence after the heading Explaining minority 
test score gains should read: "Minorities have made significant gains 
in test scores over the last 20 years and our study shows that a large 
proportion of these gains was unexplained by family changes." 

p. 1 The last line in the first paragraph should read: 
"Unfortunately, there is little agreement about what has caused the 
changes in national test scores over the last 25 years— and indeed 
there are even differences in perception about what the direction of 
test scores has been." 

p. 12 At the end of the last paragraph, insert the sentence: "This 
gain in test scores and the differential gains by racial/ethnic groups 
have been noted earlier by others (e.g., Koretz, 1986, 1992). 

p. 20 The second sentence should read: "In addition to the 
NAEPtestsof9-, 13-, and 17-year-old students, .. ." 

p. 49 In the equation for z, the second X should have a bar over 
it: X, 

p. 50 In Table 5.1, the definition of college graduate for mother's 
education and father's education should read: " = 1, il education > Hi 
years." 
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p. 52 The last word in footnote 2 shouid be changed to "cases" 
instead of "variables," 

p. 62 The top of the page should read "found in the NLSY. The 
effect of having a father with a college degree is also larger for math- 
ematics." 

p. 63 The last paragraph, second sentence, should read: ". . . and 
the gross effect takes into account " 

p. 64 The heading on Figure 5.3 should read "Mathematics" and 
not "Mathematic." 

p. 74 The last line in Table 5.8, Adjusted R a for blacks, should 
read "0.100" not "0.010." 

p. 83 The last line should read: "The NELS estimated differences 
are somewhat smaller than those of the NLSY by about 0.06-0.09 
standard deviation units." 

p. 87 In Table 6.4, add + signs to numbers in the last column that 
do not now have minus signs. 

p. 98 The first sentence under the heading Residual Differences 
should read "Figures 7.9 and 7.10 show the residual differences 

p. 1 12 In the third equation, y should be V. 

p. 113 Delete one of the two < signs. 

p. 117 In Table B.3, add + signs to numbers in the last column 
that do not now have minus signs. 



PREFACE 



There is considerable debate in our soc iety and in the research com- 
munity about the direction and causes of changes in student perfor- 
mance over the last 2.5 years: whether student performance is getting 
better or worse, whether the dramatic changes in family and 
racial/ethnic characteristics have affected average student achieve- 
ment, and whether the greatly expanded investment in education 
and other social programs and policies directed toward equal educa- 
tional opportunities were effective in improving student perfor- 
mance. 

These questions are among the most important public policy issues 
affecting our society's future. The proficiencies and future perfor- 
mance of our children will be partly responsible lor our competitive 
economic position in the world economy. In addition, children's 
outcomes will partly determine how much future public spending 
will be required to pay for such programs as prisons and the criminal 
justice system, welfare, unemployment, and job training, as well as 
health expenditures arising from treatment of addictions and victims 
of violent crimes. 

Better answers to these questions would help determine how to more 
effectively allocate the approximately $275- $.H23 billion ol public re- 
sources for K-12 education and social programs directed to support 
families and improve student outcomes. Answers to these basic 
questions would also help establish whether fundamental .100I 
reform is needed and. if so, help provide directions lor lefnrm ol 
schools and school Imancmg. 
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The effectiveness of public policies and investments directed toward 
children cannot he evaluated without accounting tor the changing 
characteristics and demographics of the American family. Many be- 
lieve that the family has deteriorated in its capacity to support the 
development of children. They point to rising levels of single-parent 
families and working mothers, a greater proportion of children in 
poverty households, and a higher incidence of births among young, 
unmarried mothers. 

Besides changes in family characteristics, the proportion of children 
from Hispanic and Asian backgrounds has increased markedly over 
the last 25 years, mainly due to immigration There has also been a 
more gradual increase in the proportion of children who are black. 
These changing demographic trends also can affect average student 
performance. If family and demographic characteristics are key fac- 
tors related to changes in average student achievement, then they 
must be taken into account before attempting to evaluate the 
effectiveness of increases in public investments and changing public 
policies. 

In this study, ue first estimate the effect that changing family charac- 
teristics and race/ethnicity of students would be expected to have on 
national mathematics and verbal/reading achievement score trends 
ol 11- IB-year-old youth between 1 970/ 1975 and 1990. Second, we 
compare these estimated effects from changing famih /demographic 
characteristics to actual trends in national achievement scores to see 
how much of the actual trend might be accounted for by changing 
families and demographics. Third, we estimate the residual effect 
that cannot be accounted for by family/demographic trends and 
offer several hypotheses that might help explain the patterns of the 
residual effects. 

This report is intended for government polk a makers, educators, re- 
searchers, parents, and tax pavers interested in how to effectively and 
efficien.ly foster higher student achievement. Research support to 
build the database used in this anaKsis was provided jointly bv 
K.WD's Institute on l-dueation and Training (ll-.T) through a grant 
Irum the l.ilh bndowment Inc. and by the Office ol the Assistant Sec- 
ictary of I 'dense tl'K.Rl. | he Depaitment of Delense is the nation's 
largest emplou'i ol youth, and as such is Utally concerned with 
changing levels ol achievement among the nation's youth. The re- 
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suits and policy implications of our research are being documented 
in two separate reports: one for those primarily concerned w ith do- 
mestic issues, and the other focusing mainly on concerns of defense 
policymakers. The results for domestic audiences are summarized in 
MR-535-1.F., Student At'hiei 'fluent and the Cluinging American 
Family: An I-xecntire Summary. This report was written under the 
aegis of the IUT. 
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SUMMARY 



BACKGROUND AND PURPOSE OFTHE STUDY 

I'here is a continuing national ck'hau- on the quality ol our children's 
family environment, the quality ol their schools, and how c hanges in 
families and schools may he affecting the level ol student achieve- 
ment. Within this debate, questions remain about whether public 
policies and increased investments in education and social programs 
are effective in improving student achievement. In addition, as the 
student population becomes more racially and ethnically diverse, 
there is "rowing concern about the inequality of educational out- 
comes between minority and nonminoritv students. 

Motivating these concerns are negative perceptions about achieve- 
ment trends, the changing family environment, ami the ell'ccliveness 
of social programs and public education. -Specifically, these include 
the following: 

• \ perceived decline in student achievement as measured b\ 
scores on the widclv publicized Scholastic \p(itude l e t (SAT). 

• A peiceived deterioration in the family environment, with par- 
ticular emphasis on lour trends: increase in the number ol teen 
mothers anil out -of- wed lurk births, increase in the number of 
cluldien living in po\ert\, increase in the proportion ol mothers 
working, and increase in the number of children living in single- 
parent families. 

• I lie perrrhed inelfrrthenr*.*. nl the wi\ Luge int teases in the 
real pel pupil k I!! educational expenditures and othei social 
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programs over the last 27> years in producing higher student 
achievement. 

Trying to sort out the relative contributions ot families, schools, and 
social programs to student achievement is a complex exercise, for 
several reasons, first, there are conflicting trends in. student 
achievement, depending on which tests are used, and a great deal ol 
c aution needs to be observed in selecting a representative test and in 
interpreting its results. Second, explaining trends is difficult because 
several factors perceived to affect student achievement have all 
changed dramatically: the family environment, demographic mix of 
students, school quality, public policies directed toward providing 
equal educational opportunity, and public investment in schools and 
social programs. Third, assessing the effect of public policies and in- 
vestment is problematic partly because empirical evidence indicates 
that family and di .nogittphic changes probably huve the largest 
effects on test seres; thus, family/demographic effects on student 
achievement need to be estimated before making assessments ol the 
effect of public policies anil investment. 

1 hese substantial changes— in family and demographic characteris- 
tics of students, the initiatives to provide equal educational oppor- 
tunity through such policies as integration of public schools and 
bilingual education programs, and the increased public investment 
in schools and social programs— all combine to make the last 23 
years a unique period in our history and provide a unique 
opportunity to understand the trends in student achievement ami 
their causes. Understanding how our families and schools have 
changed, the impact of these changes on student performance, and 
whether public policies anil investment make a difference will help 
provide answers to some of the most important public policy 
questions affecting the future of our society. 

Answering such questions and sorting out the relative contributions 
ol the various factors lo student achievement is the main purpose of 
this overall project. Tin 1 present study primarily focuses on estimat- 
ing the change in achievement test scores that can be attributed to 
changing family and demographic characteristics, family charac- 
teristics included in the analysis are family income, family size, 
parental education levels, age ol mother at i hild's birth, labor lorce 
participation ol the mother, and single-parent lamilies. Our anahsis 
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estimates the expected effects that changing family environment and 
demographic characteristics would have had on the student 
achievement scores of a national sample of students ages 14-18 
between 1970/1975 and 1990. The direction of the predicted effects 
of these family changes on test scores can provide evidence on 
whether the family environment in 1990 is more or less supportive of 
student achievement compared with the environment of similarly 
aged students in 1970/1975. If we predict a decline in scores due to 
family changes, this would reinforce the common perception that 
the family environment has indeed deteriorated over this time 
period; a predicted increase in scores would indicate more 
supportive family characteristics and environment in 1990. 

We compare our pmlictvtl changes in test scores from family/demo- 
graphic changes to (icittiit changes in achievement scores of national 
samples of youth from 1970/1975 to 1990 in order to gauge the effect 
of factors other than family and demographic characteristics on stu- 
dent achievement. If the residual hetween actual changes in test 
scores and predicted changes hased on family/demographic effects 
alone is positive, then this would suggest that other factors had a 
positive effect on test scores, while a negative residual would suggest 
the opposite. 

I wo major factors that could help account for a positive residual 
hetween actual score changes and those accounted for hy family/ 
demographic changes are la) changing public policies in the area of 
equal educational opportunity and increase!) levels of public invest- 
ment in schools and children, and lb) changing productivity of 
schools. The residual can provide some evidence about whether ef- 
lects from public polic\ and public investment and changing schools 
are present. 

To help determine il the pattern of residual differences is consistent 
or inconsistent with positive effects from public policies, public in- 
vestment, and schools, we estimate family el fens and residual differ- 
ences for black. I lispanic. and non- 1 lispanic white youth. It is possi- 
ble that minority and nonniinnrity families may have changed in 
different ways over this period and that the predicted family eflects 
differ across these groups. In addition, the effects of public policies 
and investment would not be i lie same across racial/ethnic groups 
because public policies concerning equal opportunity and additional 
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public investment in education and social programs were differen- 
tially targeted toward minority and/or lower-income families, chil- 
dren, and school districts. Thus, we might expect the indicators of 
these effects to be larger for minority groups. As such, our analysis 
provides separate estimates of family effects, the predicted change in 
test scores based on these family effec ts, and the gap between actual 
and predicted test score changes for blacks, llispanics, and non- 
Hispanic whites 

METHODOLOGY 

The methodology consists of three steps: (1 ) developing quantitative 
models linking student achievement to family and demographic 
characteristics; (2) using these models to predict test scores for a na- 
tional sample of children using their family and demographic char- 
acteristics from 1970, 1975, and 1990; and (.'{) comparing the mean 
changes in these predicted test scores between 1970/1975 and 1990 
(changes due to family and demographic characteristics) to actual 
changes in test scores of a national sample of children and estimat- 
ing a icsidual not accounted for by family/demographic factors. This 
pattern of residuals can provide initial evidence that additional 
lactors— hypothesized to be primarily changes in schools, public 
policies, and public investment— may have affected student 
achievement. 

Step 1: Estimating How Much Eamily and Demographic 
Characteristics Affect Test Scores 

We lirst estimate models linking test scores to family and demo- 
graphic characteristics; we have used two quite different nationally 
representative samples of a olescents. The datasets are the National 
Longitudinal Survey of Youth (XI.SY), 19H0, from which we selected 
students aged 15-18 years, and the National Education Longitudinal 
Survey (NKI S). 19HH, which samples eighth graders. The dependent 
variables in the models are the standardized scores for mathematics 
and verbal/reading tests that were administered to all children in the 
samples. Test scores are assumed to be a function of a set of inde- 
pendent lamih and demographic variables that are common to both 
surveys. These include family income, family structure (single- 
parent or two-parent households), I'amily size, parental education, 
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labor- force participation of ihe mother, age of the mother at child's 
birth, and race/ethnicity. These are the primary family variables that 
have changed over the last 20 years and have been linked to student 
achievement. 

Step 2: Estimating How Much Changing Families and 
Demographics Between 1970/1975 and 1990 Would 
Change Test Scores 

These equations are then used to predict test scores at the individual 
level for a representative sample of U.S. children of similar ages in 
1970, 1975, and 1990, extracted from the March Current Population 
Surveys. We compute the mean shift of the distribution of test scores 
from 1970/1975 to 1990 to provide an overall measure of the fivt ef- 
fect of changing family and demographic characteristics on lest 
sc ores. We make black/nonblack comparisons using the 1970 and 
1990 data; comparisons for three racial/ethnic groups — non- 
I lispanic whites, 1 lispanics, and blacks — are done usmg the 1975 and 
1990 predicted lest scores.' 

Step 3: Estimating How Much Changing Family and 
Demographic Characteristics Can Account for Actual 
Test Score Changes 

The third step is to compare the changes in lest scores predicted 
from changes in family and demographic characteristics to actual 
changes in national test scores. Although SAT scores are probably 
what the public most often' uses to form opinions about national test 
score trends, these scores are seriously Hawed as indicators of how 
the average achievement of American students is changing, for 
several reasons (Koretz, 19H(i). first, the SAT sample is not a 
representative sample of U.S. students. Second, the sample contains 
a constantly changing proportion and composition of students, and 
this has introduced a downward bias in scores over time. Third, from 
our perspective, a more serious Haw is that the SAT sample excludes 
students not going to college. As evidence cited below indicates, the 
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largest changes in scores over the last 20 years have probably 
occurred among lower-scoring students, who are less likely to go to 
college or to take the SAT. Thus, the SA T scores probably missed the 
students making the largest changes. 

The National Assessment of Hducational Progress (XAl-P] is a set of 
standardized tests that has been given by the Department of educa- 
tion since the early 1970s to a nationally representative sample of 
students aged 9, 13, and 17 years. The questions used for compar- 
isons over time have not changed and thus can he used for making 
comparisons of student achievement over time. These tests provide 
the best data to monitor the achievement trends of U.S. students 
over the last 2,1 years. We compare the N1.SV results for 15-lH-year 
old youth to NAM!' scores for 1 7-year-olds and the \TTS results for 
eighth graders to \.\F.P scores lor 13-year-olds. 1 hese comparisons 
allow us to calculate what proportion of the actual score changi s can 
he attributed to family/demographic changes and what remains to 
be explained by other factors. 

RESULTS 

The analvsis and evidence leported here support a more positive pic- 
ture than is usually drawn of the achievement of American students 
aged 14- 1 H \ears, the eaparitv ol American lamilies to support that 
achievement, and the elfectiveuess ol public policies and public in- 
vestment. 

How Much Do Family and Demographic Characteristics 
Affect Test Scores? 

The results Irom the NITS and XI.SV both show large differences in 
test sc ores lor famih /demographic characteristics and great similar- 
ity in the dii ection and relative significance of these differences. Fig- 
iite S.I shows simple comparisons of mathematics test stores- 
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Figure S. 1 — Simple DiiTertJUTs in Mean Mathematics I est Scores lor 
Selected Croups, M.SV and NK1.S 

among youth indifferent p.pesol families from the NLSV and X'HI.S. 1 
['lie figure shows large differences among the average test scores of 
children living in families with different levels of parental education 
or of different racial/ethnic background, i'or instance, a child whose 
mother or father graduated from college scores approximately l.O 
standard deviation higher than a child whose mother or father did 
not graduate from high school, u hile black and Hispanic youth score 
Irom ()..")() to l.O of a standard deviation lower than non-Hispanic 
whiiMouth. 

Somewhat smallei test score differences are evident among voung 
people living in lamilies with diflerent levels of annual income 
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($40,000 versus $15,000), families of different size {four siblings ver- 
sus one sibling), families having older or younger mothers (age 30 at 
birth versus age IB), and two-parent versus single-parent families, 
for instance, children living in two-parent families score about 0.30 
to 0.10 of a standard deviation higher than those in single-parent 
families, while children in large families score approximately 0.30 of 
a standard deviation lower than children from smaller families. 
Tin re is little difference in test scores between those with working 
mothers and those with nonworking mothers. 

Public debate and the press often focus on these simple comparisons 
of achievement scores for different family and demographic charac- 
teristics and mistakenly attribute the difference in scores between 
two groups to the particular characteristic in which the groups differ. 
Such inferences are misleading, however, because the students being 
compared usuallv differ in several characteristics, not just the one 
being cited, l or instance, young people in higl .-income families 
are also more likely to have parents with higher levels of education 
and to be nonminorily. fhus, the difference in average test scores 
between children from high-income families and those from low- 
income families is probably due to a combination of factors, not just 
income alone. A better measure ofthe effect of income on test scores 
is a controlled comparison of two groups of young people who have 
similar family characteristics except for income. This is true for oilier 
characteristics as well. 

figure S.J summarizes these controlled comparison differences for 
mathematics scores. 1 

Ibis figure shows that the net effect of each factor is considerably 
smaller than the simple comparisons in figure S.l. However, the 
controlled differences remain significant for certain characteristics, 
for example, youth whose parents are college graduates score about 
O.'iO ol a standard deviation higher than youth who are otherwise 
■ imihir but have parents who did not graduate from high school. In 
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Figure S.2 — Not Differences in Mean Mathematics Test Scores for 
Selected Croups, Nl.SY and NKLS 

acici it ion . controlling for other family characteristics, the different"!' 
between blacks and non-1 lispanic whites is 0.50 of a standard devia- 
tion, and the difference between 1 lispanics and non-1 lispanic whites 
is somewhat smaller. Youth with different levels of family income or 
different family sizes show much smaller differences in test scores. 
Controlled test score differences due to family structure and labor- 
force participation of the mother appear to be negligible. These re- 
sults suggest that the simple differences between youth scores in 
single- and two-parent families arise directly from other differences 
in family characteristics, such as family income, parental education, 
or family size, rather than the structure of the one-parent versus two- 
parent family itself. 

How Much Would ('hanging I '"ami lies and Demographics 
Change l est Scores? 

We use the estimates from the multivariate models (which formed 
the basis for figure S.L! above* to predict the changes in test scores 
that would be e- peeled due to the changes in family and 
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demographic characteristics iliai occurred between 1970/1975 and 
1 5190. 

We find thai 1 1-lB-ycar-olds living in U.S. families in 1990 would be 
predicted to score higher, not lower, on tests compared to youth in 
families in 1970. I he size of the shift in mean scores is approximately 
0.20 of a standard deviation. This means that youth in 1990 would be 
expected to have scores about 7 percentile points higher than their 
counterparts in 1970, based on combined changes in demographic 
and family characteristics. It should he emphasized that these find- 
ings estimate aivragi' effects when taking account of all American 
families with 14- IB-year-olds, 

Our anahsis suggests that the most important family influences on 
student test scores are the level of parental education, family size, 
family income, and the age of the mother when the child was born. 

Of these v ariables, the two that have changed most dramatically in a 
favorable directum «re parental education levels and family si/.e. 
Children in 1990 are living with better-educated parents and in 
smaller families. These factors are the primary reasons that changes 
in family characteristics would predict higher test scores. For exam- 
ple, 7 percent of mothers of 1 5-lB-year-okl children in 1970 were 
college graduates, compared to 10 percent in 1990, whereas 3B per- 
cent did not have high school degrees in 1970, compared to only 17 
percent in 1990. Similar, hut somewhat smaller, changes occurred in 
the educational attainment of fathers. Changes in family size were 
also dramatic. Only about -IB percent of 15- IB-year-old children 
lived in families with at most one sibling in 1970, compared to 73 
percent in 1990. 

( Jur analysis indicates that average family income changed little over 
thi' period 1970 to 1990 (in real terms), so it would not be expected to 
affect average lest scores. However, the decline in family size cou- 
pled with unchanged average family income mean that family in- 
come per child actually increased I rum 1970 to 1990. 

One change that has had a slight negative effect on test scores is the 
small decline in the average age of the mother at the child's birth. 
This is due partly to increased births to younger mothers, but also to 
the decline in family si/e, which reduces the number of children 
horn to older mothers. 
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The effect of the large inc rease in working mothers and single-parent 
families is more complex (discussed in more detail below). Our 
equations imply that the large increase in working mothers would — 
other things equal — have a negligible or small positive effect on 
youth test scores. 1 lowever. the mother's labor-force participation is 
measured when the youth was approximately 1-1 years old. so our re- 
sults may not apply to younger children. 

In the case ol the increase in single mothers, our models implv no 
negative effects from the changed family structure alone. However, 
such families tend to have much lower income levels, so the predic- 
tions for youth in these' families incorporate a negative impact due to 
increasing numbers of poor, single-parent families. 

We turn now to the results by racial/ethnic group between 1975 and 
1990. figures S.:i (mathematics) and S.I (vet ball show the estimated 
family effects separately for non-1 lispanic whites, blacks, and Mis- 
panics as well as ihe total youth population between and 1990. 
Higher mathematics scores in 1990 would he expected for 11-15 and 
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Figure S.4— Estimated Family and Demographic Hffects on Verbal Test 
Scores Between 1975 and 1990 by Kacial/Kthnic Group 

15-1 8-year-olds for each racial/ethnic group based on changing 
family characteristics. The data show that non-Hispanic white and 
black youth have similar predicted family gains of approximately 
0.20 of a standard deviation, but Hispanic youth show smaller gains 
of approximately 0.05 of a standard deviation. Verbal/ reading score 
comparisons show slightly higher gains lhan comparisons for 
mathematics, although the pattern is similar by racial/ethnic groups. 
The positive changes in the black family in terms of increased 
parental education and reduced family size are actually greater than 
those for non-Hispanic white families, hut there were offsetting 
increases in births to younger and single mothers. The smaller gains 
for Hispanic youth are explained by smaller increases in parental 
education, falling family income, and smaller reductions in family 
size compared to that of black families. This is probably due lo the 
continuing immigration of large numbers of Hispanic families into 
the population, many of whom may have lower levels of educational 
achievement and fewer labor-market skills lhan previous waves of 
immigrants (Horjas, HISK)), 
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How Much of Test Score Changes Can Be Accounted for by 
Changes in Family and Demographics? 

We compare our projected family/demographic effects on test scores 
to actual trends in NAKP test scores over similar time periods and for 
similar age groups to see how much of the actual changes might 
plausibly be attributed to changes in family/demographic character- 
istics. We first look at the trends in NAKP test scores, figures S.5 and 
S.6 show NAKP score differences by racial/ethnic group between 
1975 and 1990 for 1.'?- and 17-year-old students. The results show 
l^ains in actual scores on both mathematics and verbal/reading for 
13- and 17-year-old students for each racial/ethnic group. 

The NAKP gains for black, and Hispanic students are significantly 
larger than those for non-Hispanic white students on each test for 
both 13- and 17-year-old students. Cains are from 0.45 to 0.65 of a 
standard deviation for black students, 0.15 to 0.50 of a standard 
deviation for Hispanics. and around 0.00 to 0.15 for non-Hispanic 

HAND .V f 

Mathematics 



1 


Age 17 




.... «,%3''«^^S6J*'»«5?fe# v "' * 












V////////////A 




I I Non-Hispanic white 
□ Black 
B Hispanic 






Age 13 


fc^j Total population 




1 








i 








1 1 


I i 


i i 



0 0.1 0.2 0 3 0 4 0 5 0 6 0 7 



Standard deviation units 

Figure S.5— Change in NAHP Mathematics Scores by Itacial/Kthnic Croup 
Between 15)7(5 and H)!)(t for 13- and 17- Year-Old Students 
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Figure S.fl— Change in NAHP Verbal Scores by Iiacial/F.thnic Croup 
Between 1975 and 1990 tor 13- and 1 7-Year-()ld Sindenls 



whites. Thc> gains for black and 1 lispanic students have significantly 
narrowed the gap between them and non-Hispanic white students— 
although a large gap remains. Figures S.7 (mathematics) and S.8 
(verbal/reading) show these 1 reductions in the test score gap among 
racial/ethnic groups. 

We subtracted the predicted change in test scores (due to family/ 
demographic effects) from the actual change in KAVV scores to com- 
pute a residual effect. Figures S.9 (mathematics) and S.10 (verbal/ 
reading) show these residuals. The data for mathematics show no 
residual gain for non-1 lispanic white students, indicating that their 
gains in test scares could he accounted for entirely by family effects. 
But there are large positive residuals for llispanies and black stu- 
dents, suggesting that changing family characteristics alone cannot 
explain the large gains made by these students. In fact, changing 
family characteristics account for only about a third of the total gain. 
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f igures. 7— Comparison oi'Dil'ierences Between Kaciitl/Kthnic Groups in 
XAKP .Mathematics Scores in 1 9715 ami I9f!0 

For verbal/ leading scores, ihr data generally indicate smaller resid- 
ual gains than for mathematics, bm still show substantia! black and 
Hispanic residual gains not accounted lor by lamiK effects. The 
verbal/reading data also show that non-Hispanic white students 
have a small negative residual for both age groups, indicating that 
their NAId' gains were not as huge as would be expected from family 
changes. 

DISCUSSION 01' RF.SU ITS AND FUTURE RESEARCH 
The American Family 

We have used a single measure- scores— to view the effects on 
ututh of changes in the family. .,;,ile other measures ol children's 
development may show different results, this measure provides no 
evidence of a deteriorating family environment for youth who were 
I I -IK in compated to votilh who were 1-1 U! in 1'lTt}/ HI7.1. 

Sim e lamih influence starts early in a child's lile and pmbahh has a 
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Figure S.fi— Comparison of Differences Between Racial/ F.thnic Groups 
in NAH1' Verbal Scores in 1!)75 and 1990 



cumulative impact, the analysis essentially compares families from 
the late 1950s and 19b0s to those from the 1970s and 1980s. 
Although dramatic changes have occ urred in the characteristics of 
American families- in this period — some positive, some negative — 
attention has focused almost exclusively on the changes perceived to 
he detrimental to children. The families in 1990 have more highly 
educated parents with fewer children and similar levels of family 
income compared to the families in 1970/1975. These characteristics 
are strongly related to student achievement and are the primary 
reason for predicted test score gains clue to changes in 
family/demographic characteristics. 

Although our results show that average real family income changed 
little over this period, this average masks two significant changes, 
family income has been maintained for many two-parent lamilies 
onlv bv having two wage earners, and family income declined 
significantly for many children in going from a two parent to a 
single- parent family. 1 lowever, oilier charaeteristii s of a family can 
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Figure S. 9— Residual Difference Between NAKI> and Family Fffects on 
Mathematics Tost Scores for Different Uaetal/F.thnic Groups, 1978-1990 



he c hanged when a transition is made from a two-parent to a single- 
parent family or from a nonworking to a working mother. For 
insianec, these decisions can change attained educational levels, 
lamily size, and the liming ol births. So the interpretation of the 
effects of increased numbers of working mothers and single-parent 
families must take account of their indirect effects on other variables 
as well as direct effects. 

Our analysis accounts for these indirect cflects ol increased numbers 
ol working mothers and single-parent families as well as direct 
effects. Our results indicate that the direct effects on achievement 
are veiy small from increased numbers of working mothers and 
single-parent families. 

The lack ol a direct effect from the structure of a single-parent family 
is a little surprising. However, this may paitly be explained by 
previous bul unmeasured conditions that existed lor children 
(iirrentk in single-parent families when the\ were in their original 
luo-paient lamih. f'oi instance, sustained marital conflict, often 
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Figure S. 10— Residual Difference Between NAF.l' and Family Fffects on 
Verbal Test Scores for Different Raetal/Kthnic Groups, 1975-1990 



involving children, can occur before divorce. Sustained conflict 
within a family can significantly affect children's development, and 
children who live in single-parent families resulting from divorce are 
prohahlv much more likely to have been exposed to this detrimental 
environment in their original family. Thus, for these children, the 
transition to a single-parent family may not have direct negative con- 
sequences and, in some cases, might even create a better develop- 
mental environment. Thus, the lack of a direct effect on achieve- 
m( . nl _<)nce other family differences are accounted for— from being 
in a single-parent family cannot be extrapolated to imply that chil- 
dren who live in a nonconllictual or positive two-parent environ- 
ment would do as well in a single-family environment. 

Our analysis fncn-.es on changes in families with children aged 1-1-1 B 
between 1S)7() and l') l .)(). Some believe that the family environment 
may have worsened for unmger children, particularly during the last 
ten \ ears. There is some evidence to suggest that actual test score 
gains and estimated lamilv elici ts are smaller lor younger age groups 
and lor more lecetil lime periods ( I'lHO-HlilOl. Further research is 
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ongoing lo sec if the conclusions in this report are also true For 
younger children (age 6-10) over the same time period, and whether 
trends and effects are changing in more recent periods. 

Test Scores as Indicators of School Quality 

Comparisons of simple, unadjusted test scores from one year to the 
next or across different schools or districts do not provide a valid in- 
dicator of the performance of the teachers, schools, or school dis- 
tricts unless the differences in scores are very large compared to what 
might he accounted for by changing demographic or family charac- 
teristics. This is rarely the case: so, any use of unadjusted test scores 
to judge or reward teachers or schools will inevitably misjudge which 
teachers and schools are performing better. Indeed, the evidence 
provided here hints (hat a stronger case could be made that teachers 
and schools with large numbers of minority students may have been 
responsible for the most significant gains in test scores over the last 
21) years, while family effects — not schools — mav have been respon- 
sible for gains in nonminority scores. Although more research is 
needed to test these hypotheses, this evidence illustrates the 
possibility ol dramatic changes in perspective that more detailed 
analyses can provide. 

Likewise, simple unadjusted nationwide test scores can be mislead- 
ing as a basis for judging school quality, even if the statistical sample 
of students taking the tests represents the U.S. student population. 
Since family and demographic effects can affect scores as well as 
schools, the (est score trends need to be adjusted tor such effects 
before preliminary judgments are made about schools. 

Using the SAT scores as a "report card on American education" is 
even more tenuous, since the SAT does not even draw a valid statisti- 
cal sample of U.S. students. The test and samples of students taking 
it were never designed to provide indicators of national trends in 
achievement or quality ol schools, or provide a report card on 
American education. Moreover, the (wo Haws in the statistical 
sample- an expanding proportion and changing composition of 
high school students taking the test and exclusion of non-college- 
boutul students both bias the test scores downward. I xcltiding the 
non-college bound students means that the SAT misses those 
students making the largest gains o\er the last L'.'i vears. 
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The purpose of the SAT tost is to improve the college admissions 
process bv providing scores that are comparable across individual 
students. As long as comparisons are restricted to individual stu- 
dents, the test can provide useful information about students apply- 
ing to college. However, any aggregation of test scores above the 
level of the individual student— by high school, school district, state, 
or the nation— is simply uninterpretable as a measure of student 
achievement trends or of quality differences among schools, school 
districts, or states. 

An unfortunate fact is that the public perception of school quality is 
partly shaped b\ the ever-, -aiiable, but flawed, SAT scores. SAT 
scores can sjrongly influence public perceptions because they are 
more familiar, repeated frequently, have salience to people's lives, 
and often support existing opinions. Reporting of aggregated, unad- 
justed SAT scores for high schools, districts, states, or the nation ap- 
pears not onlv to serve no useful public purpose, but to confuse and 
detract from what should be a well-informed public debate about 
our families, schools, and students. Terminating the publication of 
unadjusted aggregated SAT scores might also give more emphasis 
and resources to the more statistically act urate national tests. 

Improving Data for Resource Allocation in Education and 
Social Policy 

Significantly better estimates til" family, school, community, and so- 
cial policy etlects on test scores could be obtained if there were one 
dataset that legularlv gave national tests and collected associated 
data from students, parents, schools, and communities. Although 
the NITS and NI.SV data include this information, they do not pro- 
vide trend data over time. ' Such data could be collected through an 
expanded NAIT data-collection effort, with greater information 
about parents, students, schools, communities, and district and state 
educational policies. A companion NAIT sample that starts with 
\ounger children and follows them longitudinally also seems 

'H.u.i In. mi (In- H('|i.imni'ni <>l lihuatitin make ti possible in analyze the senior 
•..mipU'- nt the N.ihnn.il I nnrjtiuhn.il MiliK ulilie 1 1101 Sehiinl < l.issol .\l s 72\ 
ami tin' I'NJ cave <>1 On- \l 1 s. I hese ilatas.'ts h.iu- 1 mnp. 'table data nti test seines 
and Uiniilv. si Iinul.aiiiltiiiiirminiiv i h.u.u teiistic s. 
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essential tor better evaluation of specific imerventions and modeling 
of the rate of learning for individual children over time. These 
changes would require significant restructuring of the \AHP design 
as well as a significant new data-collection effort entailing significant 
increases in costs. 

However, such data collected over time could provide trend data for 
almost all key variables that affect tesi scores of school-aged 
children. The result would be th.it changes in test scores could be 
more reliably related to changes in families, schools, communities, 
children's health, and district and state educational policies The 
longitudinal component starting with younger children and larger 
samples ofat-risk children would support much better evaluation of 
intervention programs as well as a much better understanding of the 
origins of poor school performance. 

Better data and research not onJy help families make better educa- 
tional decisions, but such data can support a much better allocation 
of the $300 billion or more of public funds spent annually on K-12 
education and on family, social, and community programs. The 
additional funding required to significantly expand the XAHP would 
pale in comparison to what could be saved through improved private 
and public resource-allocation decisions that the data could support. 

Assessing the Potential I-ffects of Public Policies and 
Investment on Student Achievement 

Explaining minority test score gains. Our analysis shows that mi- 
norities made significant gains in test scores over the last 20 years 
and that a large proportion of these gains was unexplained by familv 
changes. The dramatically rising test scores of minorities have re- 
sulted in a significant closing of the achievement gap between mi- 
nority and nonminority youth and less inequality in educational out- 
comes. While this is a significant -educational acenmplishment, a 
significant gap remains. It is important to understand what factors 
contributed to these gains and whether they will continue to close 
the gap in the future. 

I Ivpothesi/ed factors that might explain the residual gains must 
meet loui catena, first, the hypothesized cause must be cithei em- 
pirically linked to test scores or at least plausibly linked to having an 
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inllueiue on test scores. Second, the factor must have significantly 
changed for youth who were 1-I-1B in 1970/1975 versus those who 
were 1-t-lH in 1990. Third, it must have affected black and Hispanic 
scores significantly but had essentially no impact on non-Hispanic 
white scores, fourth, it must he a factor that would not be reflected 
through c hanging family characteristics." 

'( hanging public policies in the area of equal educational opportu- 
nity and increased public investment in children and schools fit 
these criteria. The policies directed toward providing equal educa- 
tional opportunity tertainly would have been different for 14- IB- 
\ear-old \outh in 1970 who went to school in the late IH.iOs and 
KHiOs >is opposed to similar youth in 1990 who went to school in the 
late I9,'0s and 19B0s. ; harriers ihat have been removed to equal 
"nnal opportnmtv lor blacks primarily involve access to intc- 
.'iid prnhabh more competitive k 11! schools, and improved 
K> higher education. While llispanics might base also been 
. . it h\ these policies, (lie policies insuring that language was not 
.i ha.i.ei to educational opportunity might also be expected to have 
.in imparl on Iheii test scores. 

Mm e tin major implementation nl these pohv\ changes occurred in 
die I'lTtK and 19H(K, they would be expected to alleet those children 
ironing up and attending school in the lime period that corresponds 
in out sample nl 11 I »■ \ ear-old youth in 1990. I he effects ol these 
pniii . i lunges would also be expected to primarily alleet minority 
s, oies bin io ha\e little impact on non-1 lispanic white scores, and 
would piob.ibh not be rellected through changed family character- 
isl h 

liu ie,i--es in publii iinestmeni in k I:' schools and social programs 
dilei led al lamilies ,nid i hildrrn also meet these criteria. I here wore 
di.un.ifii" tin leases in real public tmestnu'iit in schools and children 
In mi llu- PintK thrnugh the I MiUK. I'm example. I "mils ami Heklis 
pi-).' esiiniatrd thai per-capila ocal H1HH dollars! public spending 
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on children was $1,280 in 1960 compared to 52,940 in 1988 (about ;ui 
percent increase per year). Part of this additional spending was 
specifically targeted toward minority and/or youth from lower- 
income families. Since a greater proportion of black and Hispanic 
families have lower incomes, these programs would be expected to 
differentially affect minority scores. 

Although some of the increased spending on K- 12 education was not 
specifically directed toward minority youth, school administrators 
and tcachi is may have allocated more resources to lower-scoring 
youth. Since a greater proportion of black and Hispanic students 
have lower scores, minority youth would again be expected to be 
most affected if this occurred. Social programs such as Head Start 
and child health and nutrition programs directed at children and 
families also lit this pattern of differential effects for minority youth, 
although the effect of some of these programs may have been prox- 
ied by family variables included in our models. 

In addition to public investment and public policies, other possible 
explanations lor minority gains include migration trends that mav 
have placed minorities in different school districts, changing moti- 
vation of minority students, and perhaps differential returns to edu- 
cation for minority versus nonminority youth. 

One promising area of research is the development of improved sta- 
listieal models incorporating the effects of multiple risks on children. 
"I he child-development and more clinically oriented literature re- 
peatedly focuses on the deleterious effects of multiple-risk factors on 
children. The hypothesis implies that test scores might fall dramati- 
cally (nonlinoarh or exponentially) when children are under condi- 
tions of multiple risk. Basically, this means that the combined effects 
on lost scores of low family income and low levels of parental educa- 
tion may be much larger than the additive, independent effects of 
each lactur. Some students, then, may experience a slippery slope 
where achievement falls drasticalh with e\ci\ new risk thev en 
counter. Hut the reverse side of the argument is that lor such chil- 
dren, as risks decline, student achievement should go up dramati- 
cally as well. I he hitler, if true, might help explain rapid gains in test 
scores lor lower-achieving c hildren. He arc- exploring the implica- 
tions ol'lhe multiple- risk hypothesis 
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Explaining non-Hispanic white results. The lac k of a residual 
(malhematies) or a small negative residual (verbal /reading) for ntm- 
Ilispanie whites needs to be explored further. One interpretation is 
that family effects for nonminorities may he incorrectly captured by 
a linear model, because marginal differences in income, family size, 
and parental education affect higher-scoring youth less than lower- 
scoring youth.'' If the family effects are smaller in realin. then there 
would be larger positive residuals for non-1 lispanic white youth, who 
tend to have higher test scores, on average. 

A second hypothesis is that the public spending and changed public 
policies simply did not benefit non-1 lispanic whites for several rea- 
sons. One is that the most effective policies and programs may have 
been directed primarily at minorities (desegregation, affirmative ac- 
tion, bilingual programs, etc.). In addition, programs targeted to- 
ward all lower-scoring students may have been less effective for non- 
I lispanic white students because lower scoring non- 1 lispanic white 
students are more often located in rural areas. If rural areas have not 
received a proportionate share of resources ami attention, students 
there may not have benefited to the same extent as students in urban 
areas. It may also just be more diflicull to help lower-scoring rural 
youth due to their dispersion and the lack of economies ol scale. 

A third explanation is that while lower-seoring non- 1 lispanic white 
youth benefited from public investment, higher-scoring \oulh lost 
ground for several reasons, For instance, some have suggested a 
weakening of the curriculum for higher-achieving youth (Hock, 
PVB7). Also, there may have been an implicit (radcul'l in producing 
the large gains for minority or lower-scoring youth. Successful!) 
addressing the problems of lower-scoring youth tna\ have resulted in 
less emphasis and fewer resources for higher scoring students. 
These are all important issues that can be explored through future 
research. 
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The Quality and Productivity of Schools 

This study dot's not support the vim that schools o'* (lie 1970s and 
1980s have deteriorated in significant ways with respect to the 
schools of the 1950s and 1960s in their instruction in mathematics 
and verbal/reading skills. Moreover, it suggests that schools have 
made significant progress in decreasing inequalities between minor- 
ity and nonminoriu students. There have been several significant 
changes in schools in this time period, including school consolida- 
tion, large real increases in per-student expenditures, integration of 
students, changing curriculum, smaller class sizes, and a more expe- 
rienced and better paid teaelvng force. Some of these changes may 
have played a ko\ role in boosting the scores of youth, particularly 
minorit) youth. 

! Inwove r, the results are not as positive from the perspective ot edu- 
cational productivity. Hie concept of educational productivity- 
similar to that of economic productivity- -measures whether learning 
(output) per unit of resources (input] is rising or falling. Learning 
can change either because more years of education are achieved or 
because more learning occurs per year of education. Learning also 
has a dimension ol bread'h and depth. Students today may learn a 
wide i array of subjects than students ol the past, or they might learn 
each subject in more depth. I here are obvious tradeoffs among the 
various components of educational productivity. Lor example, re- 
sources can be devoted to keeping youth in school longer, to teach- 
ing a broader arrav of subjects, or to locus more resources on teach- 
ing fewer subjects in depth, 

While educational prodm livify has increased with regard to the in- 
creased student completion rates over the last L!() years, much less is 
known about the tradeoff between depth and breadth. Lor instance, 
students in the DTiOs and 1960s did not spend time learning com- 
puter skills, and time tradeoffs ma\ occur between learning new 
subjeiis and acquiring less in-depth knowledge of older subjects. 
1 Infoi tunatelv. there are no good overall meas ires of the breadth ol 
student knowledge. Moreover, we do not km u the precise level of 
c hanging resources devoted to instruction in th 'se areas. It is possi- 
ble that these added resnunes were used primarily to add to the 
breadth ol subjects, not their depth. 
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If we assume a constant level of resources and lime devoted 10 sub- 
jects, our analvsis suggests that there appear to be no dramatic gains 
in the educational productivity of schools as measured by the math- 
ematics and verbal/reading test score trends. However, these issues 
need to be explored further before a full assessment can be made re- 
garding the productivity of schools. Such an assessment w ould need 
to lake into account changes in curriculum (breadth and depth), 
lime and resources devoted to instruction, and school climate, and 
how these contribute to educational productivity over time. 

FINAL COMMFNTS 

As discussed above, this study has highlighted several questions that 
need to be answered through future research. Developing more 
complex statistical models that more accurately reflect children's de- 
velopment will further clarify the importance of the family, school, 
and community contexts and their cohtribulion to childhood out- 
comes. From our discussion, it is clear that we need to be cautious 
when using averages across all students to gauge changes in test 
scores. An average lends to obscure the fact that some groups of 
students may have markedly different results and that conditions for 
some nii.v have worsened, lowering their achievement scores. Our 
results should not be interpreted to mean that conditions have im- 
proved for every student, family, or school— only that there lias been 
a positive change when averaging across all 14- I H-\ ear-old students 
over the Uim 20 wars. 
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PURPOSE OF STUDY 

Our current national concern with economic competitiveness and 
the quality of our schools has focused considerable attention on the 
subject of student achievement as measured by standardized tests. 
Test scores are increasingly being used to assess student proficiency 
and the quality of our education system. Yet test scores themselves 
are of" value only if changes or differences in test scores can be re- 
lated lo factors causing the changes. Then test scores might provide 
sonic policy guidance as to what further changes might increase test 
scores. Unfortunately, there is little agreement about what has 
caused the changes in national test scores over the last 25 vears — and 
indeed even differences in perceptions about what the direction of 
test scores has been. 

Isolating the factors causing changes in lest scores is difficult, narilv 
because dramatic changes have occurred in several factors that have 
been linked to student achievement. These factors include dramatic 
changes in the characteristics of American families, the demographic 
characteristics of students in terms of race/ethnicity, ;. id public in- 
vestment and policies in educational and social programs, Tamilv 
and demographic characteristics are among the strongest factors ex- 
plaining differences in test scores. Therefore, the dramatic changes 
that have taken place in the American family and in demographic 
trends over the last 20-2.1 years would be expected to affect trends in 
student achievement. The changes in the family are often cited as 
tleirimental to children and include an increased proportion of 
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children living in hamehnlds below the poverty level, in single-par- 
ent families, in hpnies with working mothers, or in families with 
younger, unwed mothers. The demographic characteristics of the 
student population ha\e also changed— most dramatically in the 
proportion of students who are Hispanic. Given these changes, an 
important question is: Did the family and demographic changes ai- 
led student achievement levels over the last 20--25 years? 

During this same period, public investment in children and families 
increased markedly (Kuchsand Reklis, 19921. Per-capita real expen- 
ditures in K--12 education more than doubled from 1967 to 1992. In 
addition, many new programs and policies directed at improving 
children's outcomes were initiated or expanded. These included 
Head Start, nutrition and health programs, compensatory education 
programs, the integration of public schools, and family income sup- 
port. These programs might also be expected to improve student 
achievement. However, previous empirical research suggests that 
their effects might be smaller than those associated with family and 
demographic changes. As a'result, the effect of changing public in- 
vestment and public policies on test score trends cannot be accu- 
rately estimated without first accounting lor the changes in the fam- 
ily and demography. 

This study develops estimates of the expected effect of changing 
famih and demographic characteristics on student mathematics and 
reading/verbal lest scores of 11 -IB-year-old students from 1970/ 
1975 and 1990. We develop estimates ol family/demographic effects 
far nationally representative samples of American youth ages 14-15 
and 15-18. We also develop separate estimates for Hispanic, black, 
and non-Hispanic white students. We then compare these estimated 
changes resulting from lamilies and demographics to actual changes 
in test scores lor nationally representative samples of similarly aged 
students lor similar periods. We use the only national tests that can 
provide scores for a representative sample of youth over this 
period -the National Assessment of Kthicaltnn.il Progress (XAKlV 
The difference between actual XMT changes and estimated effects 
resulting from tamih and demographics provides preliminary evi- 
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denee that factors other than family influence tc-M scores, the most 
likely candidate being changes in public policy and public invest- 
ment in education and social programs during the period, future re- 
search is needed to better identify and estimate these ellects and 
their causes. 

RELEVANCE TO CURRENT POLICY DEBATES 

Many of the current policy debates ongoing in American education 
are based on differing assumptions about the direction ami causes nl 
historical changes in test scores and what these changing test scores 
imply about the quality of education and the direction of future 
policies. Although this report cannot address each of these issues 
described below, further research that builds on this stuck can in- 
form these debates. 

Reliance on l est Scores for Teacher and School 
Accountability 

The perception of declining student achievement anil declining 
school quality despite higher real levels of spending has initiated a 
movement toward more accountability. Increased testing at the na- 
tional, state, and local levels is being implemented with an immedi- 
ate goal of trying to obtain better measures of output and establish a 
firmer basis for accountability of teachers, schools, and school sys- 
tems. Underlying this movement is the assumption that simple 
comparisons ol scores over time or between teachers, schools, or 
school districts c an sene as a basis for judging the quality of teach - 
ing, schools, or school districts.-' If changes in family or demographic 
characteristics underlie changes in test scores, test score 
comparisons that fail to account for these differences are even more 
Hawed. 

Null'!,' I"' 1 ! w.nn-. ,i;\iiit-ti ihi-. imi' nl le.i'nivuj: v.iii-!) hi' ill-' m-h-s 1 1 v< - •»».!<■• \ \l I' 
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Allocating Funds Between Richer and Poorer School Districts 

The nirrenl debate over allocating slate educational expenditures 
between richer and poorer districts is partly predicated on the as- 
sumption (hat higher test scores in wealthier districts are due to 
higher expenditures and better school quality. An alternative expla- 
nation is that differences in family characteristics account for most 
or pari of these score differences. If so, simple reallocation of school 
expenditures may not produce better student achievement without 
also addressing fa mil) issues in poorer districts. Without a better 
understanding of the ela u of families compared to schools, these 
important resource allocation issues between rich and poor districts 
cannot he answ.'ted. 

School Reform and School Choice 

Part of the motivation fen - fundamental school reform conies from a 
common perception that lest scores have been stable or have de- 
clined over the last 20 years despite the large additional investments 
made in schools and social programs. This implies that additional 
investment in education would have little payoff without fundamen- 
tal reform of the swem. However, this hypothesis that additional 
investments did not have an cllect on test scores does not take into 
account the changes in demographics and the American family and 
their possible effects on test scores. It is possible that lamily and 
demographic changes depressed test scores and the additional pub- 
lic investment prevented even further declines. 

One particular relorm school choice -has also been championed 
In those who point to the higher achievement - and sometimes 
lower costs-- ol students in private schools. I lowever. a key question 
is whether the prinilc schools themselves or the characteristics of 
families sending children to private schools are responsible for the 
higher scores at such scho.ils, and whether the marginal child who 
transfers to a private school will benefit to the same degree, \gain. 
the relative contribution of lamilies compared to schools is an 
important undcrh ing issue. 
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Allocating Public Resources to Schools or Family Support 

Another issue is how public investments can most effectively be allo- 
cated between expenditures to support education and expenditures 
to support families. State, local, and federal governments spend 
about $250 billion annually to support primary and secondary edu- 
cation in the United States. Less than $59 billion is spent on pro- 
grams aimed at supporting families and children,' 1 Whether addi- 
tional investments in education or additional investments in family 
programs would provide the larger return on investment is a crucial 
question, especially given our constrained fiscal environment. 
Answering this question requires, among other things, better models 
that provide quantitative estimates of the contributions of family and 
public investments to student achievement. 

Productivity and the Level of School and Family Investment 

( hir competithe economic position depends partly on the growth of 
worker productivity and partly on the level of future public resources 
that will need to be devoted to social spending to pay for programs 
suc h as prisons and the criminal justiee system, wellare, unemploy- 
ment, job training programs, and health expenditures arising from 
treatment of addic tions and vic tims of violent crimes, both worker 
productivity and future social spending depend partly on student 
achievement. Poor achievement in school is frequently associated 
with dropout behavior and subsequent poor labor-market outcomes 
(Kaplan and Luck, 1977; Kumberger, 19B3; Pallas. 198-1; L.kstrom et 
al., I9B5; Uchlage and Hutter, 19B(>; Wagenaar, 1987; llagan, 1991; 
I nsminger and Slusarcick, 1992). Studies of military enlistees have 
shown that those who score higher on aptitude tests are more likely 
to perform better on a wide variety of tasks, to more often complete 
iheii terms of enlistment, and to have fewer disc iplinary problems 
(Crissmer and kirbv, 19HH; Marquis and kirby, 19H9; Kirby and 
( irissmer, 199.'h. 

A ke\ question is whether higher level*, of investment in schools and 
Litnilies would be recouped through better economic performance 
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and reduced fmurc public expenditures. Although there is stitl much 
debate concerning the precise link between academic achievement 
and economic output (Kendrick. 1980; Bally. 1981). a recent article 
(Bishop, 1989) provides one estimate of the effect of test score 
declines on productivity growth. Bishop estimates that if test scores 
had continued to grow at the rate that prevailed between 1942 and 
1967. labor quality would have been about 3 percent higher by 1989, 
and 1987 gross national product (GNP) would have been about S86 
billion higher. Indeed, he forecasts that the social cost, in terms ol 
forgone GNP, will double over the next several years and he implies 
that even if academic achievement rises markedly, the test score 
decline will continue to depress productivity into the next century. 
However, a remaining question is: What level of investment would 
be required to boost test scores? This question may be answered by 
analyzing the effect of the large additional investments of the last 20 
years. 

AN OVERVIEW OF METHODOLOGY AND RESULTS 
Methodology 

Our analysis of the effects of changing family environment and de- 
mographic composition on test scores is based on two nationally 
representative samples of students. The first is the National 
Longitudinal Survey of Youth (N'LSY), which sampled 12.500 1-1-21- 
year-old youth in 1979 primarily for the purpose of studying labor- 
force participation. In 1980. each respondent was given the Aimed 
Services Vocational Aptitude Battery (ASVAB)— a test that measures 
mathematics, reading, and several other vocational aptitudes, he 
second is the base year National Lducation Longitudinal Sur.'c-y 
(NT.I.S) of about 25.000 eighth graders in 19BH. Mathematics i.nd 
reading tests were also administered to this sample. Both databases 
have data on family characteristics c ollected from both respondents 
and their parents. 

Models relating family characteristics to test scores are devt snpotl for 
15- 18- year- old youth from the Nl.SV and for eighth graders from the 
NITS. Usin^ two independently drawn and tested samples for dif- 
lerent age groups helps ensure that the results are not specific to a 
paiticular age, a parlietilai sample, or a particular test. I he set ot 
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variables used in the model is limited to variables that are common 
to both datasets; however, this includes most of the family character- 
istics that earlier studies have shown to be most strongly reiated to 
achievement scores. These are family income, mother's and father's 
education, mother's age at child's birth, family size, family structure, 
and the w orking status of the mother. 

The estimated models are then used to predict test scores for the 
child samples drawn from the 1970, 1975, and 1990 March Current 
Population Surveys (CPS). These surveys contain a nationally repre- 
sentative sample of U.S. youth and families for those years. This pro- 
cedure yields predicted test scores for each child, based on family 
and demographic characteristics at that time. Shifts in the predicted 
test score distribution over time are due to the interaction of two 
factors: the importance of the variable in predicting test scores 
(measured by the estimated coefficient) and the extent of the change 
in the variable over the relevant time period. We calculate a mean 
test score for each predicted test score distribution; the difference in 
the mean test scores provides an estimate of the net effects of chang- 
ing family and demographic characteristics over the time period. We 
estimate changes for the total population and separately for non- 
Hispanic white, black, and I lispanic youth. 

We compare this difference in mean test scores to actual differences 
in test scores reported by the \'AKI\ The NAHP administered tests to 
nationally representative samples of 9-, 13-, and 17-year-old students 
from the early 1970s through the 1990s. These comparisons allow us 
to assess the extent to which family and demographic changes 
account for actual test score changes and the importance and 
relevance of other factors in determining test score changes. A gap 
between actual changes in NAKP scores and our estimates of family 
and demographic effects provides an initial indicator that other 
factors may have affected student achievement. 

Results 

Om results run counter to the "conventional wisdom" that a deterio- 
rating family environment and changing demographics may have 
lowered test scores. Our results show that the net effects of change-, 
m (arnih and demographic characteristics I mm 1970 to 1990 would 
predict higher- -not lower- -test scores. They show that changing 
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family and demographic characteristics would predict an upward 
shift in mean verbal and mathematics test scores of between 0.10 
and 0.20 of a standard deviation (or 3-7 percentile pointsl from 1975 
to 1990. The results are very similar for children aged 14-15 (the 
sample to whom the XMLS eighth-grade model was fit) and those 
between 15 and IB years (the sample to whom the Xl.SV model was 
fit). The primary reasons for estimated gains in test scores are 
significantly higher parental education levels and smaller family size. 
Our estimates for separate i acial/ethnic groups show that the net 
effect of changing family factors is generally more positive for black 
and non-Hispanic white children than for Hispanic children. 

The NA1T* mathematics and reading scores also show gains in test 
scores for 13- and 17-\ ear-old students that are similar in magnitude 
to those predicted from family and demographic effects done. 
However, there are major differences for demographic groups. I he 
NAI-I' scores show very large gains for black and Hispanic students 
but small gains or losses for non-Hispanic white students. 

Although we predict significant gains in black test scores because ol 
changing family characteristics, these factors alone can account for 
only about a third of the substantial gains made by blacks on the 
XAl'P. Similarly, Hispanic students made significant gains on the 
NAl-P that cannot be accounted for by family changes. In contrast, 
the gains made hv non-1 lispanic white students on the XAI-P can be 
completely accounted for by family changes. The results imph that 
there are large residua! gains in minority scores not accounted lor by 
family changes, but no residual gains for while students. Perhaps the 
more viable hypothesis for accounting for these residual gains is in- 
creased public investment in schools and social programs and 
changing social policies such as school desegregation and bilingual 
education. These factors can plausibly he linked to school achieve- 
ment, hau' changed markedK over the last 25 years, and might he 
expected to ..fled minority students neuh more than nonminority 
students. It is possible that other tacts; m'.ght also account for some 
ot these gains, but it is difficult to think of factors that affect scores, 
have changed markedly between 1970 and 1990, and would be ex- 
pected to differentiate, affect minoritv students. 
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ORGANIZATION OF THE REPORT 

< hapier fwo reviews test score trends and changes in family and 
demographic composition over the last 20 years, along with previous 
uurk attempting to link family and demographic characteristics with 
test score trends. Chapter Three describes our methodology and 
data sources. Chapter Four describes the theoretical framework for 
■mah/ing family effects on student achievement and several empiri- 
cal findings from previous literature. Chapter Five presents the re- 
sults of the multivariate analyses linking family characteristics and 
achievement scores from both the \I.SY and the NHl.S. Chapter Six 
tabulates the results of using these equations to predict test scores 
lor national samples oi children in 1970, 1975, and 1990. Chapter 
Seven i (impales our predictions with the actual NAFP results. 
( onclusinns are presented in Chapter Fight, along with implications 
and suggestions loi luiui'e research. 



Chapter Two 

TEST SCORE TRENDS AND THE CHANGING 

AMERICAN FAMILY 



in this chapter, we first review the trends in national test scores and 
the trends in family and demographic characteristics. We then 
review studies that have attempted to relate trends in lest scores to 
changing demographics and family characteristics. 

RHV1EW OF TRENDS IN NATIONAL TEST SCORES 

Only one test has been designed and administered over the last '.'.'■> 
years with the specific purpose of monitoring the average achieve- 
ment trends of nationally representative samples of American stu- 
dents — the NAEP. We first discuss the trends in these scores, and 
then discuss the better known SAT and the reasons why the SAT is 
not a reliable test for monitoring student achievement over time. 

The National Assessment of Educational Progress 

For more than two decades, the NAhP. funded b\ the Department o| 
Education, has been the most important source of information on 
trend* in the academic achievement of American students. The 
NAHP assesses student perfotmanec in various subject areas, includ- 
ing reading, mathematics, science, anil writing, for nationally repre- 
sentative students at ages 5), Ki and 17. For this study, we used stu- 
dent lest score trend-, in mathematics and reading for 1.1- and 
17-year-old students. The blocks of mathematics and reading 
questions used to measure trends have been the same since the early 
l!h'()s. allowing lot accurate trend data. 
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NAi-P develops a nationally representative sample of students 
through a complex four-stage cross-sectional sample. In the first 
stage, primary sampling units (PSUs) were derived from dividing the 
United States into geographic units that consisted of metropolitan 
statistical areas (MSAs), a single county, or a group of contiguous 
counties. In the 1990 trend sample. 97 PSUs were selected in the first 
stage. In the second stage, schools were selected within each PSU 
with probabilities proportional to assigned measures of size. In the 
third sample stage, modes of testing were assigned to the schools. In 
the fourth stage, age-eligible students within schools were randomly 
selected to lake the assessment. Students were not assessed if they 
had limited Pnglish proficiency, were considered mildly mentally re- 
tarded (educahle). or were functionally disabled (for more details on 
the NAIiP. see Johnson and Allen. 19921. 

The NAKP tests were given at approximate four-year intervals in the 
1970s and early 1980s and have been given more frequently since 
then. The earliest tests that can he used as a basis for monitoring 
trends accurately is the 1971 verbal/reading and the 1973 mathemat- 
ics test. I lowever. these tests do not identify Hispanic students. The 
first tests where Hispanic students are identified are the 1973 read- 
ing/verbal tests anil 197B mathematics test. Since the [import • ol 
llispa'nics has increased markedly, our primary emphasis is on the 
1975-1990 verbal and the 197H-1990 mathematics test comparisons. 

figure 2.1 shows the average differences in lest scores converted to 
standard deviation units for 13- and 17-year-old students between 
197! and 1990 for verbal/reading and between 1973 and 1990 for 
mathematics. I'or each age group, students scored higher on each 
test in 1990 than in the earlier period. I'or 1 7-year-cld students tak- 
ing the verbal/reading test, a movement ol 0.1 1 ol a standard devia- 
tion indicates that the average student in 1990 scored about \ per- 
centile points higher than the corresponding student in 1971. Thus, 
from the earliest point at which nationally representative samples of 
students can he tracked using tests with similar test items over time, 
ihe evidence shows that students in 1990 did better than students 
from the earh 1970s in both verbal/reading anil mathematics scores. 
1 lowever, an important question is whether the gains are different by 
racial/ethnic groups. 
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Rgures and L'.3 show changes in mathematics and vrrbaW reading 
scores lor black and nonhlack students lor similar periods. The data 
show that both Ki- and !7-\ear-old black students have made very 
substantial gains— -between 11.53 and 0.7 ol a standard deviation — in 
both mathematics and verbal/ reading scores between the earh 
1070s and 1000, The scores of the nonhlack population have either 
gained or lost about 0.1 of a standard deviation. The large gains in 
black scores have almost cut in hall' the gup in hlack/nonblack test 
scores that existed in the earh I:)7()s. 

Pari of the reason for small ^ains or losses for nonblacks could be the 
huge increase in I lispanic students, so it is also important to separate 
the scores ol the black. I lispanic. and non-Hispanic while student 
population. The first time that I lispanic students were identified 
separately in the XAIT tests was in the vetbal/reading tests given in 
H)7."i and the mathematics tests given in I07H. figures 2. A and 2.7> 
show the changes in mathematics and verbal/ reading scores ol the 
black. I lispanic, and non-1 lispanic white population for these tests. 
I he stoic dillerences show that black students made the Luges! 
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Figure 2.2 — Change in NAF.P Mathematics Scores by Race and Age 
Croup Between 1973 and 1990 
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Figure 2.'.\ — Change in NAEP Verbal Scores by Race and Age Croup 
Between 1971 and 1990 
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Figure 2.4 — Change in NAEP Mathematics Scores by Racial/Ethnic 
and Age Croup Between 1978 and 1990 

HAUL'*.' J 

Verbal 



White 
Black 
Hispanic 

White 
Black 
Hispanic 





A';e 17 


I 










Age 13 

I 


I 

J 


1 

1 1 1 i,,. 



-0.1 0 0 1 0 2 0 3 0 4 0 C OR 0 

Standard deviation units 

Hgure 2.5— Change in NAM' Verbal Scores by Hacial/l tlinir 
and Age Croup Between I '(75 and 1 99(1 



6 u 



Hi sitkk'nt Achk'vi'mcni and (hf ( hantjiiij; American lamil\ 



gains in these time periods but that Hispanic students also made 
significant gains, with non-Hispanic white students either making 
smali gains or showing losses. 

The larger minority gains have partially closed the gap between mi- 
nority and nonminority scores. figures 2.0 and 2.7 show the gaps be- 
tween racial/ethnic groups in mathematics and verbal/reading 
scores for the 1975-1990 time period. For both age groups and both 
tests, the gains made by blacks have decreased the test score differ- 
ences by approximately -10 percent. There has also been a smaller, 
but still significant reduction in the gap between non-1 lispanic white 
and Hispanic scores. A gap still exists in 1990 between the scores of 
black and Hispanic students and those of non-Hispanic white stu- 
dents, but the size of that gap has been significantly reduced since 
the 1970s. 

These results, showing gains in scores from the 1970s to 1990 for 
each age group and test, with si/able gains for minority groups, often 
run counter to the public perception of the direction and pattern of 
student achievement. Public opinion about declines in student 
achievement and the quality of schools is parth based on trends in 
the SAT, which show declines in mathematics and verbal scores. SAT 
scores are highly influential in shaping public opinion. Un- 
fortunately, there are problems in using the SAT to gauge trends in 
lest scores or make judgments about the quality of .American edu- 
cation. 

Scholastic Aptitude Tests 

Comparing NAEP and SAT test score trends. The trends in the SAT 
are shown in figure 2.8. The average test score declined markedly 
between the late 1900s and the early 1980s. Mean scores on the 
mathemalH s portion declined 20 points from 19(57 to 1981 . The de- 
cline was even larger on the verbal portion: 12 points over the same 
time period. Since then, the mathematics scores have risen some- 
what and leveled off, but they are still 10 points below the 19(57 levels. 
Verbal scores increased slightly during I9!ff)-1987 but appear to be 
on a downward trend and currenllv are back lo the low score of 1981 . 
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Figure 2.1!— Mathematics and Verbal Scores for the Scholastic 
Aptitude Test, 1967-1991 

Figure 23 compares tin- change in the SAT score with the change in 
the NAI-P scores for 17-year-olds over similar time periods. The two 
tests show conflicting results for verbal scores, with the SAT scores 
showing a decline of nearly 0.3 of a standard deviation and the NAF.P 
showing a gain of about 0.1 of a standard deviation. The mathemat- 
ics trends are in closer agreement but still show a difference of about 
0.1 of a standard deviation. Figures 2.10 and 2.1 1 compare NAhP 17- 
vear-olds and SAT verbal and mathematics scores for black and non- 
Hispanic white students. 1 The data show substantial disagreement 
between the NAHP and the SAT over the size of black score gains. 
W hich scores, then, should be used for tracking student achievement 
trends over the lavl LV> years? 
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Figure 2.9 — Changes in SAT and NAEP Scores 
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Analyses ofa wider sei of tesi score measures that have more statisti- 
cally reliable samples than the SAT leave little doubt that test scores 
oi' representative samples ol American youth probably declined 
during the l%0s and somewhat into the P)7()s but overall ha\e not 
declined and probably have increased over the lasi 20 years (Korel/. 
!')H(i, 1<)87, \W2: 1 inn and Dunbar, PUKli. In addition to the \.\1-P. 
(il'H-, 13-, and 17-year-old students, the Iowa Tests ol' Basic Skills and 
the noiming tests lor the Preliminary Scholastic Aptitude Tests show 
higher scores (I. inn and Dunbar. IJIilOl, This latter test is adminis- 
tered by the College Hoard to a nationally drawn sample at approxi- 
mate si\-\ear intervals, and the results show no e\ idenee ol declining 
lest scores. 

Problems with the SAT tests Tor monitoring trends. I he S \ I' trends 
are misleading as indie. itois ol achievement trends lor \meriean 
\oulh for two reasons. The first is that the sample olAoiuh taking the 
test is not selec ted In the ( ollegc Hoard to represent any particular 
sample ol' U.S. youth. Rather, the SAT sample is sell -selected, 
meaning that whoever applies to lake the SA I lest determines the 
sample lot dial \eai. V- a if. tilt, eai h Veai die sample t lunges in 
si/e and composition. I he si/e and composition ha\e changed 
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markedly over time and primarily reflect the increasing proportion of 
seniors wanting to apply and enter college. In general, the effect of 
changing sample si/.e and composition has been a downward bias in 
test score trends. However, the size of this selection bias cannot be 
accurately estimated, since the College Board does not collect several 
important control variables that could be used to estimate year-to- 
year corrections. 

The shifting si/.e and composition of the SA T population is signifi- 
cant. In 1967 about 30 percent of high school seniors took the test; 
by 1992, this proportion had increased to 40 percent. Researchers 
believe that this increasing proportion may account for part of the 
decline in test scores during the late 1960s and early 1970s, since the 
additional students taking the tests generally have come from a lower 
achieving population (Rock, 1987). However, the effect of changing 
si/c since the early 1970s is more uncertain. 

In addition to changing sample si/.e, the composition of the test 
population has changed, with increasing proportions being minori- 
ties and women. Minorities — on average — score lower on achieve- 
ment tests; women have significantly different patterns in verbal and 
mathematics scores than men. Changes in year-to-year SAT scores 
can reflect changing sample size and changing sample composition, 
as well as real changes in student achievement, and it is not possible 
to separate these effects. Thus, changes in SAT scores should not he 
used to measure achievement trends. 

\lthougli the bias in the SAT resulting from self-selection has been 
the most publicized and studied, the SAT scores are subject to an 
even more potentially serious bias. The SA T is taken by only about 
■10 percent of high school seniors — those who plan on applying to 
college. Since other teMs have shown that the primary gains in 
achievement over the last 20 years have probably occurred among 
lower-scoring and minority students (Linn and Dunbar, 1990; 
Johnson and Allen, 1992), the SA T prohahly misses those students who 
hare registered the largest seore gains. The combined effect of self- 
selection and failuie to include these lower-scoring students- both 
ol which downwardh bias the SAT scores— -makes the SAT trends 
highly misleading indicators of trends in achievement among 
\merii an students. 
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SAT scores and public opinion. Despite convincing analytical evi- 
dence of the SAT's inherent downward bias, public opinion "ontin- 
ues to rely on the SAT scores. However, this may not be as puzzling 
as it first appears. Theories regarding how people make inferences 
concerning statistical data help explain why an impression of declin- 
ing test scores might develop and persist. For example, Nisbett and 
Ross (1980) review evidence showing that people make inferential 
judgments from data that are more salient, vivid, emotionally inter- 
esting, and frequently reported than from data that are more statisti- 
cal^ accurate but not as widely reported. 

Since the SAT tests have been taken by one-third to one-half of 
American students annually for over 30 years and the results are 
quite critical to the college admissions process, these tests have 
much greater exposure and leave vivid impressions on students and 
parents alike. They are often reported several times a year in differ- 
ent forms— national results, state results, and school district and 
school results. In addition, local school scores are often used as a 
basis for judging school quality, desirability, and even real estate 
values. 

In contrast, the NAHP tests, which provide a more statistically accu- 
rate picture of test score trends, are taken approximately every four 
years by small samples of American students and have virtually no 
effect on the lives of individual students who take them. Thus, it is 
not surprising that people tend to give more weight to the SAT results 
than to the NAHP scores. 

Research also indicates that mixed evidence— for example, evidence 
that NAHP scores are moving in an opposite direction from that of 
the SAT scores— often results in stronger, not weaker, trust in the 
originally held belief (Nisbett and Ross, 1980). This is partly because 
people tend to select and read information that agrees with prior 
expectations. As such, the more frequently reported SA T will tend to 
reinforce people's beliefs, whereas the less frequently reported NAHP 
scores might easily be dismissed. In addition, the understanding re- 
quired to make judgments about the statistical validity of samples is 
not widespread. Thus, despite their superior sampling procedures, 
the NAHP or similar tests simply will not be used by most people to 
make judgments concerning test score 'rends as long as SAT scores 
are available. 
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The potential damage from public opinions based on SAT perfor- 
mance is exacerbated if individuals believe that lower scores reflect 
the declining quality of schools. Nisbett and Ross (1980) also suggest 
that such naive inferences are consistent with evidence about how 
people form such inferences. In particular, people have strong ten- 
dencies toward "single cause" explanations and tend to choose those 
that resemble the effect. Thus, the commonly held association be- 
tween school and test scores would lead to naive judgments such as 
declining test scores being the result of declining school quality. 
Actually, studies of achievement repeatedly show that family and 
demographic characteristics have stronger effects on scores than 
differences in schools or teachers (Coleman et al,, 1966; Coleman 
and Hoffer, 1987; Jencks ct at., 1972; Gamoran, 1987). Variables mea- 
suring school, teacher, or community characteristics are nearly al- 
ways far weaker and more inconsistent in explaining the variance in 
test scores than are demographic or fami.lv factors. Unfortunately, 
the SAT tests do not collect essential family characteristics needed to 
account for their effects. Since they cannot account for changing 
demographic and family characteristics, changes in SAT scores can 
provide no sound evidence concerning the quality of American edu- 
cation. 

Although the SAT test might provide useful inform ation concerning 
an individual student's college performance, any reporting of aggre- 
gated unadjusted scores across schools, districts, states, or tiie nation 
not only appears to serve no useful public purpose but contributes to 
misleading impressions about schools and students. Terminating 
the publication of unadjusted aggregated SAT scores would remove 
these misleading data that are so influential in shaping public opin- 
ion. It might also lead to quicker funding and initiation of the collec- 
tion of more valid, policy-relevant data. 

THE CHANGING AMERICAN FAMILY 

Given the increase in test scores among nationally representative 
samples of youth over the last 2i) years, we need to examine whether 
the "deteriorating" family environment and changing demographics 
may actually have prevented even further gains. We now review tliat 
issue. 
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Increasing test scores omnred during a poritul of dramatic changes 
in the structure of families and in demography. Many sociodemo- 
graphtt" trends mentioned in the literature and popular press are 
viewed as having adverse effects on family environment and edu- 
cational outcomes (/.ill and Rogers, 198B; l-uchs and Rekiis, 1992; /ill, 
I 'I'll' • \mong the more prominent trends mentioned are: 

. \ soaring divorce rate that has resulted in a higher incidence of 
single-parent families, primarily headed by single women. By 
I %(., the number of children under the age of 1 8 who were living 
with their mothers only was 1.1,2 million, an increase of 76 per- 
cent ovet the number ol such children in 1970. Although the ef- 
lects ol divorce upon children are debated, Uhlenberg and 
I ggebecn il9Kti] point to three particularly detrimental conse- 
quences ot divorce to the overall well-being of the child: emo- 
tional upheaval associated with the divurce, decline in family 
iiu nine, and the sharp decline in the time spent with the noncus- 
todial parent. Survey data reveal that only one in six children 
living with their mothers had weekly contact with their lathers 
.iltei the divorce. However, divorce can also remove a child from 
,i conllictual lamilv environment— a condition that has been 
show n to be detrimental to a child. 
• \ sharp rise in the birth rate of single mothers, particularly 
among minorities, l or example, in 1970, 10.7 percent ol all 
biiths weie to unmarried women: by H)B/>, this had climbed to 
.'2.1! pen cut. About «) percent of all black births and "n>, percent 
ol I lispanic births were to unmarried mothers, nimpai.; 1 to less 
than If) percent of births to white mothers, hi fact, in HH18, 
about \J. percent ol all first births in the United Slates were to a 
inoihei who was either unmarried, a high school dropout, or a 
teenager: II percent were at risk for all three conditions (/.ill. 
I'j'i. 1 . I here is some reason to believe that the adolescent preg- 
ii.iik v late underestimates the iise in pregnancies among un- 
m. lined adolescents, bet am e of the sharp rise in the aboriion 
i. ue among this group. In addition, there are other conse- 
quent es ol sexual behavioi that also create additional problems 
tin teenagers lor example, the number of adolescents contract- 
ing veneie.il diseases has grown rapidly (Uhlenberg anil bgge- 
hcell. l'tiih 
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♦ An increase in the number of children living in poverty, after a 
sharp decline during the late 1960s and early 1970s. In 1986. 20 
percent of children under age IB were below the poverty line; for 
black, and Hispanic children these rates were 43 and 37 percent, 
respectively. One reason for this high poverty rate is the high 
incidence of single-parent families, generally female-headed 
households, which tend to have far lower incomes than those of 
two-parent families. Poverty brings with it a whole range of risks: 
poor adolescents are 50 percent more likely to have physical or 
mental disabilities; poor young adults, regardless of race or 
ethnic background, are three times more likely to drop out of 
high school; low-income teenagers are more likely to be victims 
of violence (Simons, l-inlay, and Yang, 1991). 

• A marked increase in the civilian labor-force participation rate of 
women with children under the age of 18. As of 1990. 68 percent 
of married women with children under the age of six were 
working part-time or full-time outside of the home, compared to 
about 30 percent in 1970. This growth in maternal labor-force 
participation is popularly cited as a negative influence on 'he 
well-being of children. 

Uhlcnberg and Kggebeen (1986) elaborate on this point and its rela- 
tionship to the well-being of children: 

And as mothers increasingly work outside of the home, the interac- 
tion between mother and child, as well as parental supervision, in- 
evitably declines .... From the perspective of the child, it appears 
that parents are becoming available at time", convenient to the par- 
ents, not at times when the child has the most need for attention 
!p. .*7j. 

All of these facials have led to the general perception that the family 
environment in which children arc being nurtured has deteriorated 
over the last 20 years. Perhaps, I'uehs and Heklis (1992) capture the 
current mood best: 

American children are in trouble. \'ot all children, to be sure, but 
nianv observers con ulrr today's children to be worse oil than their 
parent'.' generation, in several important dimensions of physical, 
mental, and emotional Melt being ip ill 
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In addition to these factors, there has been a dramatic demographic 
shift in the racial/ethnic composition of families. Over the time pe- 
riod, 1975-1990, the proportion of Hispanic children in the popula- 
tion increased sharply from 5.8 percent in 1975 to 9.5 percent in 
1990— an increase of over 60 percent; the proportion of black teens 
increased very slightly over the same time period, from 13.5 percent 
to 13.9 percent. Minority students tend to score lower on standard- 
ized tests than nonminority students and the increasing proportion 
of minority students would tend to lower average test scores. 

LINKING CHANGING FAMILY CHARACTERISTICS AND TEST 
SCORE TRENDS 

Several studies have suggested a link between changing family and 
demographic characteristics and trends in test scores (Koretz, 1987, 
1992; Fuchs and Reklis, 1992; Armor, 1992). Koretz (1987) mentions 
four family- and demographic-related variables in his list of potential 
factors affecting the trends in test scores: family size/birth order, 
single-parent households, maternal employment, and ethnic com- 
position. The report concludes that family size/birth order and eth- 
nic composition could have made very modest contributions to 
trends in scores, but that the evidence for contributions from in- 
creases in single-parent families and maternal employment were in- 
consequential or inconsistent. 

Fuchs and Reklis (1992) do not make explicit connections between 
family characteristics and test scores, but they cite several trends in 
family characteristics between 1960 and 1988 and suggest that lower 
test scores are one possible outcome of these trends. These adverse 
trends include increasing numbers of children living in poverty, a 
rise in the birth rate of unwed mothers, and increases in the numbers 
of single-parent families and working mothers. However, they also 
are the first to emphasize the three positive trends in children's 
environment during this period— an increase in the parental 
education level, an increase in the income per child, and a significant 
increase in real governmental spending directed at youth. The latter 
figure includes elementary and secondary school spending as well as 
all programs directed at the health and welfare of children. Income 
per child has increased although family income has been fairly stable 
because the number of children per family has declined markedly. 
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Armor (1992) analyzes factors that might account for the large gains 
in black, students' test scores over the last 20 years. He considers 
three factors: desegregation, compensatory programs, and socio- 
economic changes. He concludes that the rising education level of 
black parents is probably the most important component for 
explaining black test score gains. For instance, he estimates that 
about 8 of the 19 point gain on NAEP scores might be accounted for 
by rising parental education levels. He states: 

The strongest correlate of black achievement gains in the XAEP ap- 
pears to be improvements in the socioeconomic status of black 
families, the si/.e of which is comparable to the gains in 
achievement. This explanation is consistent with the large body of 
educational research that identifies socioeconomic status as the 
strongest influence on both black and white achievement [p. 80). 

SUMMARY 

We reviewed the trends in national tests and discussed their 
strengths and weaknesses. We pointed out that public opinion is 
sharply influenced by the SAT; however, the SAT is not a valid indica- 
tor of the average achievement of American students. Rather, the 
NAEP, which repeatedly assesses student achievement using repre- 
sentative samples, is a much better source of data on achievement 
trends. Thus, we rely on the NAEP trends in our analysis. 

This chapter also reviewed studies that attempt to link test score 
trends to family/demographic characteristics. None of these studies, 
however, attempted to directly quantify the net effects of demo- 
graphics and important family factors using national samples of 
youth. They generally relied solely on whether family factors consid- 
ered one at a time show trends similar to those shown by the test 
scores. I lowever, univariate relationships can be somewhat mislead- 
ing when more than one factor is important in explaining test scores 
and when some factors do not overtly mimic the changes in test 
scores. This study uses a multivariate model linking test scores, de- 
mographics, and family characteristics that allows us to make 
quantitative estimates of the net effect of changing demographics 
and several changing family characteristics on test score trends. We 
use these equations to actually predict and compare test scores in 
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1970 and 1990. Although our work significantly extends previous re- 
search, it represents a first step in model building and some uncer- 
tainty stiil remains regarding the precise effects of different charac- 
teristics on test scores. Further research is currently under way — this 
includes extending and refining the present model to take into ac- 
count interactions and nonlinearities in relationships, and using the 
unique strengths of each database separately rather than restricting 
the models to variables common to the two datasets. 

The next chapter presents our data and methodology. 
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METHODOLOGY 

Tin's stuck develops estimates of the net effect of the changing family 
and demographic environment on student verbal /reading and 
mathematics test scores over time, and an estimate of the effect o( 
factors not associated with family and demographic changes. The 
methodology consists of three steps: (1) developing equations relat- 
ing student achievement to family and demographic characteristics; 
(2) using these equations to predict test scores for each student in a 
national sample in 1970, 1975. and 1990 using their family and de- 
mographic characteristics; and (3) comparing the mean differences 
in these predicted test scores (estimates of the effect of changing 
family and demographic characteristics) to actual scores from the 
N'AHP. This procedure provides an estimate of how much family and 
demographic changes contributed to actual changes in test score.-,, 
and the residual changes in test scores (actual minus family and 
demographic effect) provide an estimate of the effect that other 
factors had on changing test scores. The methodology is illustrated 
in Figure :\.\ . 

Modeling Student Achievement 

Figure .\.2 illustrates schematically the first step of our methodology. 

We first estimate models linking lest scores to family and demo- 
graphic characteristics using two quite different nationally represen- 
tative samples ol adolescenis. Both samples were given mathematics 
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Standardized test score - F(ina ne, mother's education, father's education, 
family size, race'ethmcitv. ...) 

Model 1 Regression on the pooled sample 

Model 2 Separate regressions for blacks. Hispanics. non-Hispanic whites 



Prediction Equations: 

Predicted teM v:oro - intercept - bl (income) + b2 (family size) + .... where bl. 

b2 are the estimated regression coefficients from 

Models 1 and 2 above 



Figure 3.2— Step 1 : Modeling Student Achievement 
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and verbal/ reading achievement tests and data were collected on 
family characteristics. The samples are for different age groups, use 
different stratification criteria, and use different achievement tests. 

We use both sets to make independent estimates of the family and 
demographic effects to see if the results are sensitive to a particular 
age group, sample size, sample stratification, or achievement test. 
However, because we specify similar models across both datasets, we 
were restricted to choosing measures of family and demographic 
characteristics that were common to both. Fortunately, the datasets 
included the most important family and demographic variables that 
have been shown to be related to achievement. 

The datasets are the NLSY, 1980, from which we selected students 
aged 15-18 years, and the Nl-LS, 1988, which samples eighth graders. 
The dependent variable in the models is the standardized test score 
for mathematics and verbal/reading tests and it is assumed to be a 
function of a set of independent family and demographic variables 
that are common to both surveys. These include family income, 
familv structure (single mother or two-parent households), family 
size, parental education, labor-force participation of the mother, and 
age of the mother at child's birth. 

For both the NLSY and the NITS samples, we estimate models relat- 
ing family characteristics to test scores for the full sample (i.e., pool- 
ing all racial/ethnic groups) and for separate population groups- 
blacks, llispanics, and non-1 lispanic whites. The models described 
in the body of the report are based on the unweighted samples, al- 
though weighted regressions were also estimated and are reported in 
Appendix C. We note differences in the magnitude of some of the 
coefficients estimated from the weighted and unweighted regres- 
sions in Chapter l ive. However, there is little difference in the pre- 
dicted test scores from the two models (Step 2 of the methodology). 

Predicting l est Scores for Samples of Youth 

The second step in our methodology is illustrated in figure TT 
which shows that the prediction equations derived from estimating 
Models 1 and 2 are used to predict test scores at the individual level 
for a representative sample of U.S. Hiildtrn ol similar ages in 15)70, 
15)75, and 195)0, using family and child characteristics extracted Irom 
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Figure,'?,;* — Stop 2: Predicting Test Scores tor Samples of Youth 



tlic March Current Population Surveys. Tor the 1970 and 1990 com- 
parison, we make predictions using two racial/ethnic groups: black 
and nonbtack. 1 This procedure yields a distribution of predicted test 
scores for 1970 and 1990. Changes in this test score distribution will 
relied both the relative strength of individual family and demo- 
graphic factors on test scores (as captured by the estimated coeffi- 
cients in the equations) and the extent to which each factor changed 
over the time period. We then compute the difference in the mean 
values of the distribution ol test scores for 1970 and 1990 to provide 
an overall measure of the net effect of changing family characteristics 
on test scores. 
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We also est i male family and demographic- effects from 1975 to 1990 
using three racial/ethnic groups; non-Hispanic whites, Hispanic*, 
and blacks. 

Comparing Differences in Mean Predicted Test Scores to 
Actual Scores from the NAEP 

The third step (shown in figure 3.4) is to compare the changes in test 
scores predicted from changes in family and demographic character- 
istics from these nationally representative samples to actual changes 
in test scores from the \.\KP. We compare the Nl.SY results for 15- 
1 8-year-old youth to XAKP scores for 17-year-olds, and the Mil S re- 
sults for eighth graders to XAKP results for 13-year-olds. 

DATA 

National Longitudinal Survey of Youth 

The NI.SY is a longitudinal survey of l2,(iH() civilian and militarv 
youth aged 1-1-21 starting in 1979 (Outer for Human Resource 

I. Predicted Differences in Test Scores 

Differences in mean predicted I 
test scores: i 

_ CPS. 14-15-year-olds j 

J II. Actual Differences in Test Scores 

I 

Differences in mean test scores. I ; Differences in mean test scores 

NAEP. 17-year-olds ] - NAEP. 13-year-olds 



J_ ± 

Comparison of I and II provides an assessment of the relative contributions ot 
changing family and demographic characteristics and other factors 

to actual changes in test scores 
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Research, 1992). It consists of three distinct subsamptes: (Da cross- 
section sample designed to be representative of noninstitutionalized 
civilian youth residing in the United States in 1979 and born between 
1957 and 1964; (2) a supplemental sample that oversamples civilian 
Hispanic, black, and economically disadvantaged non-Hispanic, 
nonhlack youth: and (3) a military sample of youth born between 
1957 and i9Bl and serving in the military as of September 30, 1978. 
All civilian sample selection was done through a multistage stratii.ed 
area probability sample of dwelling units and group quarters, with a 
moderate degree of oversampling to obtain sufficient samples of the 
targeted groups in the supplemental sample. The sample has been 
followed from 1979 and surveyed each year, although the military 
sample was dropped as of 1985, and the supplemental sample was 
last interviewed in 1990. Of the 12,686 who constituted the original 
sample in 19~9, about 96 percent or 12,141 were .etained in the 
sample for the 1 980 survey round. 

In 1980. the Department of Defense used the Nl.SV sample to update 
the norms of tne ASVAB, a multidimensional achievement test, con- 
sisting oi 10 subtests (Bock and Moore. 1984). A total of 11,914 civil- 
ian and military Nl.SV respondents completed the test. The test is 
generally regarded as a reasonable proxy lor what might be consid- 
ered general intellectual achievement or G1A. This is a summary 
term for the developed cognitive abilities, competencies, and knowl- 
edge that contribute to productivity in most jobs. It has also been 
shown that trends of" aptitude tests scores (such as the ASVAB) paral- 
lel trends for achievement tests (Koretz. 1986) and correlate well with 
broad spectrum achievement tests (Bishop, 1989). 

Our analysis sample is restricted to i 5-18-year-olds in 1980 and only 
the civilian sample (both the cross-section and the low-income 
sample) for two reasons, first, family income data were collected for 
the household in which the individual resides; for young people aged 
19-22 and those in the military, this household was often a separate 
household established by the individual, and the income data do not 
match the "family" income data lor younger respondents. Second, 
this group is more homogeneous in terms of major activities and ex- 
perience. Most of the 1 5-1 8-year-olds are still in school, whereas the 
19-22-year-old age group includes college students and employed 
(for example, those in the military) and unemployed labor- lorcc par- 
ticipants. 
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For each respondent in the selected sample, we computed an aver- 
age mathematics score by taking a simple average of the individual 
raw scores on the arithmetic reasoning and numerical operations 
subtests; for the verbal score, we used an average of the raw scores 
on the word knowledge and paragraph comprehension subtests. 2 

National Educational Longitudinal Survey of 1988 

The 1988 NELS surveyed and tested about 25,000 eighth-grade 
students in 1,035 American schools during the base year 15)88,-' 
Sponsored by the National Center for Education Statistics (NCI'S), 
this survey was a two-stage, stratified probability sample with 
schools selected as the first-stage unit and students within schools as 
the second-stage unit (for more details see Ingels et al., 1990), After 
random selection of schools, 26 eighth graders within each school 
were randomly selected; if schools had fewer than 2(5 students, all 
eligible students were included. Some schools were oversampled to 
ensure that adequate numbers of students were available from sub- 
populations of interest (e.g., Hispanic/I.atinos and Asians). 

In addition to these student data, parents were surveyed about fam- 
ily characteristics, their educational expectations for their child, their 
involvement in school activities, and financial support for future 
schooling. Parent data were available for about 94 percent of the 
students in the base year. The survey requested that the parent who 
was better informed about the child's learning activities fill out the 
questionnaire. Of the parent survey respondents, about 80 percent 
were mothers, 17 percent were fathers, and the remaining 3 percent 
were other male or female guardians. For the purposes of this study, 
measures of family characteristics were based on parent reports 
rather than student information because parents are more likely to 



"We did tmi specifically adjust the test scores to account for the fac t that individuals 
were of different ages when thev tool, the test in ItiHEt, Oldei students did better, in 
general, on the ASVAH than Younger students, However, we tested versions of the 
M SY models with specific age dummies and found that only the intercept term was 
affected. The intercept term reported in Chapter l ive is thus a weighted average ol the 
test scores for I.Vlfl-vear olds. 

ITtere are both public and restricted -use \ersinns ot ihe NT 1 s data: we an.iH /rd the 
testui trd-use data hies. 
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offer valid information about family income, parental education, and 
other sensitive family aspects (see Kaufman and Rasinski, 1991). 

N'F.LS contains student test scores in the areas of mathematics, 
reading, science, and history/government (see Rock and Pollack, 
1991 ). Only the mathematics and reading tests were analyzed for this 
report. The reading test consisted of 21 multiple-choice items that 
measured student comprehension and interpretation of five short 
passages that varied in length from one paragraph to a half- page. 
The eighth graders were given 21 minutes to complete this test. The 
mathematics test lasted longer, 30 minutes; it contained 40 items and 
rvquired students to make quantitative comparisons aivl to provide 
answers to word problems, diagrams, and calculations. 

March Current Population Surveys 

We used the March CPS to obtain nationally representative samples 
of families of 15-18-year-olds and 14-15-ycar-olds for 1970, 1975, 
and 1990 The monthly CPS is the primary data source for obtaining 
lahor-force statistics on employment and wages of U.S. civilian 
households. An expanded version of the monthly CPS is given in 
March to a much larger, representative sample of the civilian U.S. 
population. The data collected include an extensive set of informa- 
tion on each household from which several family characteristics can 
be derived, including family income, family size, age and education 
of mother and lather, working : ':'''is of mother, and whether singlc- 
or two-parent households. The prediction sample sizes for the 14- 
15-year-olds ranged between 5,000 and b.Oi.'O, somewhat smaller 
(4,200) for 1990; for the 15-18-year-olds, the sample sizes were 
between 10,000 and 12.000 (again somewhat smaller for 1990— 
8,000). Only those children living with parents or adults were 
included in the prediction samples. 

SUMMARY 

This chapter presents the various steps used to estimate lam- 
ilv/demographic effects on student achievemeiu trends and de- 
scribes the databases analyzed in the study. To reiterate, these steps 
include: ( 1 ) estimating the ellei ts ol taniily and demographic charac- 
teristics on student achievement using XI.SY and NP.l.S; (2) predict- 
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itlg test scores for youth in the 1970, 1975, and 1990 CPS using our 
models in step (1); and (3) comparing the mean differences esti- 
mated from the CPS to the actual differences in the NAliP. This al- 
lows us to measure how much family and demographic changes 
contributed to actual changes in test scores. The residual changes in 
test scores suggest that other factors affected changes in test scores 
besides the family and demographic characteristics included in our 
models. 
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Chapter Four 

STUDENT ACHIEVEMENT AND FAMILY 
CHARACTERISTICS: LITERATURE REVIEW 



NEED FOR A MORE COMPREHENSIVE FRAMEWORK 

Developing a theoretical framework that links student achievement 
and family and demographic characteristics is a critical part of de- 
veloping improved hypotheses and models. Such a revi nv would 
need lo draw from several disciplinary and interdisciplinary areas of 
siudv. These would include literature from traditional educational 
H'mmivIi, sociology, economics, child development, child psy- 
( hnpathohigy, clinical psychology, and family systems theory. F.ach 
.ilea has developed strands of a theory and has a developed literature 
ih.it could lie used lo formulate hypotheses and better understand 
lilt- complex relationships between families and student achieve- 
mi ni In illustrate, we briefly review three disciplinary views of 
families and schools from economics, child development, and soci- 
ology 

IllRFK PERSPECTIVES ON THE FAMILY AND STUDENT 
ACHIEVEMENT 

I at h perspective starts with a different paradigm or framework con- 
t fining what is important in producing youth outcomes, and each 
uses methods and approaches tailored to their field of study. 

I he basic economic model linking child achievement to family char- 
.i( tciistics has as its foundation both theories of production as well 
as ihe human capital approach explicated by Becker (1981) and 
IVi ker and I omes i P)H(i). Parents are assumed to help their children 
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achieve, using parental time, family resources, and the '-hild's innate 
endowment as inputs. Thus, although there is some transmission of 
genetic ability, a child's achievement is also conditioned on the 
learning environment that parents provide and on their preferences 
for schooling and achievement. This model specifies achievement as 
a function of parental income, parental time, parental tastes for 
learning, and the ability endowment of the child, inherited from the 
parents. There is assumed an inherent tradeoff between child 
"quantity and quality." That is, the more children in a family— other 
things equal— the fewer the resources that will be available per child. 
Intrafamily allocation of resources toward activities that develop 
achievement as well as different allocations to different children help 
explain differences in children's outcomes. An overall budget con- 
straint is imposed by family income and market prices, including the 
opportunity cost of parental time. 

This resource-oriented model helps explain why family income lev- 
els, family size, and parental education levels might be important in 
explaining differences in test scores. ITfccts of working mothers and 
single-parent families— other things equal— are also seen from a re- 
source perspective — less time av ailable from parents for children. It 
has a harder time explaining win children of younger parents— other 
things equal— might score lower. A primary problem with this per- 
spective is it deals only with resources of time and money, and takes 
no account of the emotional resources necessary for a child's devel- 
opment as well as differences in parenting skills. 

The developmental perspective that spans areas of study including 
child psychology, child development and psychopathology. and 
fam il v systems theory is anchored more in the study of emotional re- 
sources within the family and their effect on individual children's de- 
velopment. Children are assumed to be quite different in the timing 
and direction of their development, and to be sensitive to different 
environments. Intellectual development is seen as a gradual unfold- 
ing in stages, in keeping with the increased internal ability of the 
child to handle more complex phenomena. Success at later stages ol 
development depends on successful learning of tasks at earlier 
stages. Kmphasis is placed on the role of parents in establishing 
emotional bonds to the child, and providing appropriate continuing 
emotional support as well as a structured and stable environment 
conducive to learning. 



84 



Student Achievement and I'aniiK C.h;.: u tenstu s: Literature Review li 



Many family environments arc identified as being detrimental to the 
development of the child and eventual achievement (these are often 
referred to as dysfunctional families). Such families are character- 
ized by parental conflict, character or psychiatric disorders in par- 
ents (depression, schizophrenia, etc.). and emotional, physical, or 
sexual abuse of children. Literature on this topic also points to sev- 
eral health conditions that can lead to differences in achievement 
such as hyperactivity, attention deficit disorder, lead poisoning, and 
depression. A particular hypothesis that arises from clinical work in 
this field is the multiple-risk hypothesis, which posits that children 
can be resilient to some adverse conditions, but they face serious 
achievement failures when they are subjected to several. 

Developmental theory has a very richly conceived theory of chil- 
dren's developmental path, but it often ignores the larger resource- 
allocation questions that inevitably arise when scarce public re- 
sources need to he allocated across large groups of children. In this 
area, a melding together of economic and developmental theories 
could offe>- richer insights. 

A strand o'" sociological theory views schools as playing a primary 
role in increasing student achievement, and this research focuses on 
determining the characteristics of schools (per-pupil expenditures, 
organization, class sizes, environment, tracking modes, etc.), teach- 
ers, curriculum, and textbooks that can explain variances in test 
scores. In this literature, family variables are acknowledged as ex- 
plaining part of the variance and are included usually as control vari- 
ables so that the school-related variables of interest can lie measured 
accurately. However, there has generally been little emphasis on 
explaining why family characteristics are related to test scores 
(Coleman and 1 loflcr. H1B7J. 

More recent literature in this field acknowledges the role of parents 
in helping schools in their teaching roles. This literature emphasizes 
cultural differences among families of different origins as helping ex- 
plain achievement score differences. Differences in parenting styles 
have also been identified as determinants of student achievement. 
However, the emphasis still remains on making schools more 
ellective as the pritnan option to boosting student at hiovemenl. 
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As part of the broader study, we are developing an integrated frame- 
work that draws on these various perspectives (as well as others). 
However, extant data for examining factors affecting student 
achievement over time do not have the necessary information to 
capture the complexities suggested by this interdisciplinary frame- 
work. Given that our primary purpose here is to examine the extent 
to which changes in family and demographic characteristics ac- 
counted for test score trends, we have restricted our analyses to the 
set of variables that is common to several national databases. 

The next subsection discusses the findings from previous studies that 
examine the link between family and demographic characteristics 
and student achievement within multivariate models. 

EMPIRICAL LITERATURE: FAMILY CHARACTERISTICS AND 
STUDENT ACHIEVEMENT 

Our selection of variables in our analytical models was dictated by 
two considerations: (a) comparability across the datasets used for 
estimation purposes (NLSY ond NEI.S); and. (b) availability of the 
same variables on the datasets used for prediction (March CPS files). 
Rather than attempt an exhaustive summary of the literature on stu- 
dent achievement and its determinants, we focus our attention on 
findings that relate to the family variables that arc included in our 
models. 

Family Structure 

As wr had seen earlier, it has frequently been argued that children in 
single-parent households may be shortchanged in terms of both 
money and time and thus may tend to perform more poorly in 
school. In addition, '.here may be a detrimental effect on intellectual 
performance from the father's absence 

! letherington, Carv.ara, and I'eatherman (1981) in their comprehen- 
sive review find that there are consistent differences favoring chil- 
dren from two-parent families, in achievement and grade point aver- 
age. However, the differences in achievement are too small to be 
meaningful. Milne et al. (19HB) find that although the total differ- 
ences are fairly substantial, the negative effects on achievement of 
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living in one-parent families are almost entirely due to intervening 
variables such as income, mother's employment, parental expecta- 
tions, and parental help with homework. 

Krein and Beller (1988) use matched mother-child data rom the 
NLSY mother-child sample to investigate this hypothesis. They find 
that the negative effect of living in a single-parent family increases 
with the number of years spent in this type of family, is greatest dur- 
ing the preschool years, and is larger for boys than girls. Controlling 
for income does not diminish thjse effects. 

Hanushek (1992) finds somewhat different results — the presence or 
absence of an adult male in the family appears to have no effect on 
achievement, once income is held constant. Hill and O'Neill (1993) 
report that the marital status variables have only weak and statisti- 
cally insignificant effects on children's test scores, when other factors 
such as mother's characteristics and family resources are taken into 
account. Desai, Chase- Lansdale, and Michael (1989) also find that 
family structure has very little effect on child outcomes, holding 
other factors constant. 

The findings with respect to the effect of family structure on 
achievement appear to be somewhat mixed but generally do not of- 
fer overwhelming support of the common perception that marital 
disruption or absence of the father has a detrimental effect on 
achievement. 

Family Size 

There is a substantial amount of literature on the effects of size of 
family on achievement. Blake's (1989) main hypothesis is that num- 
ber of siblings will have a negative effect on child achievement out- 
comes because of a dilution of familial resources available to chil- 
dren in large families and a concentration of such resources in small 
ones. The dilution occurs both in divisible resources such as parents' 
time, emotional and physical energy, attention, and ability to inter- 
act with children as individuals, but also in material resources and 
the environment that these material resources can provide. Being 
brought up in a large family generally means some dilution in pri- 
vacy and freedom from impingement by other siblings; it also dilutes 
children's urgency to associate outside the family group, thus mak- 
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ing them more parochial and limited in understanding of a variety of 
social roles. Additionally, as Zajonc (197G) suggests, the overall intel- 
lectual level of the home may become more "childlike" in large fami- 
lies because the presence of young children may inhibit adult con- 
versation, vocabulary, and interests. 

Some have argued that family size effects are spurious and are 
merely measuring additional parental characteristics that have been 
omitted in the model, such as parental IQ, parental personality char- 
acteristics, and parental perceptions of desirable qualities in children 
(Linden, 1977). Blake insists that genuine family size effects exist 
and their magnitude in many cases is substantial. Even after con- 
trolling for major parental background characteristics, she finds dif- 
ferences in total educational attainment— approximately two years 
of schooling— between small and large families. The negative edu- 
cational effects of large families can be somewhat offset by some 
forces—such as the Catholic church, kin cohesion among some 
ethnic groups, high parental socioeconomic status (SF.S), or a 
combination of these influences. The analysis also isolated family 
size effects specifically for verbal ability, which is generally strongly 
related to parental attention and interaction. The magnitude of the 
effects of family size on IQ is large, with only children generally doing 
better than multiple siblings. Children from small families are more 
likely to engage in intellectual and cultural pursuits, to spend more 
time playing alone, to be more popular, and to have more confidence 
in their own ability. She also reexamines /.ajonc's explanation of the 
decline in SAT scores in terms of average birth order and shows that 
it may have more to do with average family size than birth order. 

Hanushek's (1!)92) underlying conceptual model assumes that par- 
ents allocate their time to maximize total or average achievement by 
their children. Parental time is of two types- "public" time, which all 
children share and which is in the nature of a public good that can be 
consumed by :ill without lowering the amount available to other 
children; and "private" time, which is child-specific and which, of 
course, declines as family size becomes larger. Thus, achievement of 
each child can be expected to fall with the addition of more children. 
The results confirm the tradeoff between quantity and quality of 
children. Annual achievement growth of each child in the family 
falls, but at a declining rate, as family size increases. Within families, 
birth order appears to have little effect on performance. He also es- 



h6 



S'udem Achievement and lamily ( !haracteristics: Literature Review 45 



timates that changes in family size- that occurred over the past two 
decades help explain half or more of the aggregate changes in the 
sixth-grade Iowa achievement tests over the period 1965 to 1985. 

Hill and O'Neill (199:5) reinforce these findings: On average, test 
scores on the Peabody Picture Vocabulary Test (PPVT) fall two points 
for each additional child and the effect is highly significant. 

A more recent study may indicate that a broader perspective is 
needed than a simple one of children in a family competing for 
scarce resources. Children may also be considered as resources 
themselves. For instance, older children may be able to help younger 
children. The study of the achievement of children of Vietnamese 
immigrants to the U.S. (Caplan et al., 1991, 1992) shows a positive 
and significant sign for family size, which is attributed to the fact that 
in immigrant families especially, older children may be significant 
resources within the family system. 

Educational Attainment of Parents 

As we said above, educational attainment of parents may be a proxy 
for the cognitive abilities of the parents and thus affect the innate 
endowment of the child. It may also be a proxy for cultural variables 
such as persistence and emphasis on and taste for learning, all of 
which should strongly influence the child's achievement. Higher ed- 
ucational attainment has been linked to the provision of a more 
stimulating home environment and to values that encourage self-di- 
rection in a child (Kohn, 1983; Bradley, 1985). Direct tests of the ef- 
fect of parental educational attainment on children's achievement 
are few — most studies tend to subsume this variable under the more 
global variable measuring the family's SFS. Hill and O'Neill (1993) 
explicitly include mother's education and find that an additional 
year of mother's schooling raises the average PPVT score bv about 1.2 
percentile points. The importance of this varirMe diminishes when 
they control for the number of times the mother reads to the child. 
However, it is likely that the two are highly correlated and the moth- 
er's effectiveness in providing a stimulating, learning environment 
probably depends partly on level of maternal educational attain- 
ment. Menaghau and Parrel (1 9!) I) find that mothers with higher 
levels of schooling provide better home environments, as do mothers 
with moie complex occupations (who tend to have higher sciiooling 
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as well). An earlier p;mer {Parcel and Menaghan, 1990) discusses the 
intergenerational effec.s of maternal work experiences on children's 
verbal facility. They argue that mothers who work in occupations 
with more complex activities tend to provide more enriching home 
environments than those who work in less complex occupations, and 
so help develop critical cognitive skills that enhance child achieve- 
ment. 

There is little empirical evidence of the independent effect of pater- 
nal educational attainment ot.ee family income and mother's edu- 
cation levels are included. We include father's education to better 
measure the intergenerational transmission of cognitive ability, as 
well as the cultural environment at home. 

Age of Mother at Child's Birth 

The age of the mother at a child's birth and test scores are likely to be 
related, perhaps not directly but because of several intervening fac- 
tors. The resources parents can devote to their children will vary 
over time and will influence achievement. However, these effects are 
likely to depend strongly on family size as well. In addition, young 
mothers are more likely to be in their teen years, children them- 
selves, with little ability to parent a young child. They are more likely 
to be unmarried and less educated and, therefore, economically de- 
prived—all of which will affect the educational outcomes of their 
children. Moore and Snyder (1991) used data from NI.SY to examine 
(he effects of early childbearing on the cognitive lest scores of three- 
to seven -year- old firstborn children. The mother's age at the child's 
birth was less important as a predictor of the child's cognitive score 
than the mother's score on a test of cognitive achievement. Hill and 
O'Neill (1993), however, find that the mother's age at the child's birth 
has a positive and statistically significant effect on children's scores, 
although IVsai ct al. (1909) find little effect. 

Family Income 

The relationship between income or more broadly Sl-S and achieve- 
ment is fairly well documented. More recently, Hill and O'Neill 
(1993) find thai income has a positive and significant effect on chil- 
dren's test scores: An increase of $10,000 per year would increase 
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scores by 2.4 percentile points, although the effect is nonlinear. 
Hanushek (1992) finds that permanent income has a systematic ef- 
fect on achievement, although current income does not, suggesting 
that a policy of increasing current family income by itself may not 
translate into higher achievement. 

Maternal Employment 

The relationship between maternal employment and educational 
outcomes has been the subject of much heated debate. Some have 
argued that maternal employment directly decreases the amount of 
time available for each child and increases the stress on the mother 
because of the dual role and so has a negative effect on achievement. 
Others believe that employment can enhance a woman's sense of 
self-worth and satisfaction with life and will lead to her providing a 
better home environment. 

Leibowitz (1974) finds that the quantity and quality of a mother's 
time spent in preschool home education have a significant effect on 
her child's 1Q. Milne et al. (1986) find that the significant effects of 
mother's employment on children's achievement is primarily nega- 
tive but differs by child's age, race, family structure, and the amount 
of time the mother works. Gottfried et al. (1988) present research 
that examines family environmental processes and children's devel- 
opment as related to maternal employment. Their position is that it 
is the proximal home environment that is important rather than 
employment status per sc. They used a longitudinal dataset that 
followed children over a seven-year period but did not find any neg- 
ative effect of maternal employment status on children's develop- 
ment, although the number of hours worked was negatively corre- 
lated with achievement measures. However, employed mothers hold 
higher educational expectations for their children, and higher edu- 
cational expectations are related to higher cognitive development, 
academic achievement, and social development. 

1 loffrtum (1989), in a review of the effect of maternal employment in 
the two-parent family, concludes that maternal employment gener- 
ally adds lo the morale of mothers and that parental attitudes are 
more important than mother's employment status. Blau and Gross- 
berg (1992) find that although maternal employment has a negative 
effect on young children's cognitive development during the first 
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year of a child's life, it is potentially offset by a positiv e effect during 
the second and subsequent years. Similarly. Desai el al. (1989) find 
that the overall effect of maternal employment on the intellectual 
ability of four-year-olds is negligible. 

SUMMARY 

This chapter briefly illustrates the importance of an integrated 
framework, drawn from several disciplines, in modeling student 
achievement. However, it is difficult to find comprehensive data that 
would allow us to fit such complex models. Given data limitations, 
we focus in this study on a set of family and demographic variables 
that are available in several national databases. We review previous 
studies that show the importance of these variables in explaining 
differences in student achievement. This set of variables includes 
family type, family size, age of mother at child's birth, educational at- 
tainment of parents, maternal employment status, and race/ 
ethnicity. 
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MULTIVARIATE ANALYSIS OF ACHIEVER 



This chapter describes the development of the equations used to 
predict individual test scores for children ages 14-15 and 1 5—1 8. 

ANALYSIS VARIABLES 

V ariable definitions for the analysis variables in the model of student 
achievement are provided in Table 5.1. The definitions are matched 
across the two datasets. 

The dependent variables in each model are standardized, weighted 
mathematics and verbal/reading ^-scores. These are calculated from 
the test scores on the mathematics and verbal/reading tests given to 
the respondents on the two datasets. weighted across all observa- 
tions. For a sample with mean .Y and standard deviation s, me sam- 
ple ..--score for a particular observation X, is: 

- _ -v, - v 



1 he numerical value of the .c-score reflects the relative standing of 
the observation. I he c-seore distribution has a mean off) and a 
standard deviation of 1 and thus allows comparisons of performance 
on different tests, fhe c-srores can easily be translated into per- 
centile units— a more commonly used measure — using the fact that a 
standard deviation shift is approximately iff percentile points, 
uheie.is a shift ol 0.10 ul a standaid deviation is a shift ol about .!. 1 
percentile points. 
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Variable N ame 

Dependent variable 
Mathematics score 
Verbal score 

Independent variables 
Family income 
N umber of siblings 
Age of mother at 
child's birth 

Mother's education 
Less than high school 

Some college 



College graduate 

Father's education 
Less than high school 



Some college 



( ollcge graduate 



Single mother 



Mother working 

Kace . cthnicits 
Black 



I lispanic 



1 em, lie 



Table 5.1 
Variable Definitions 



netinition _ _ 

W eighted, standardized r-score 
Weighted, standardized c-score 

!9B7 dollars (000s) 

Total number of siblings, aged Ifl or younger 

Age of mother at birth of child 

-l.il education < 1^ years 
= 0, otherwise 
= I, if l.'i years ^education 
sis years 

- 0 otherwise 

a I. if education s Ifi veals 
= Ij, otherwise 

-i.it education < 1^ yeais 

- 0. otherwise 

= 1 . if I :\ years < education 
£ I 7s years 

-- 0. otherwise 

- I . if education ; Hi \ ears 

• 0, otherwise 

- 1 il child lives in a single-parent household, headed 
by mother 

- 0. otherwise 

- I . if mother is m the labor tone 

0 otherwise 

l.ildi.kl is black 

• i). otherwise 

1 . il child is ot Hispanic origin 

- (I, otherwise 

1 II child is Inn, lie 
o otheiwise 
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Table 5.1 (continued) 



\'ariable Name 



Region dummies 
Northeast 



- 1 . if child lives in Northeast region 
= 0. otherwise 



North Central 



= 1 . if child lives in North Central region 
= 0. otherwise 



West 

Missing value dummies 
Income missing 



- 1 . if child lives in the West 
= 0. otherwise 

= 1 . if income is missing 
= 0. otherwise 



Mother's education 
missing 

Father 's education 
missing 

Number ol siblings 
missing 

Age ol mother missing 



- i . if mother's education is missing 
= 0. otherwise 

- 1 . if father's education is missing 

- 0. otherwise 

= 1 . if number of siblings is missing 
. f). otherwise 

- 1 . if age of mother is missing 

- 0. otherwise 



hne ol household 
missing 

Mother's woik status 
missing 



- I . if type ol household missing 
.. II. otherwise 

- 1 . il mothet \ work status missing 

- (I. otherwise 



Most of the independent variables are self-explanatory. Family in- 
come is expressed in 1 9R7 constant dollars (000s). Other continuous 
variables are age of mother at child's birth and number of siblings. 
The number of siblings used in the analysis includes only siblings 
who were l!i years old or younger living in the household. Thus, our 
family size variable will be a better measure for the NHI.S eighth- 
grade sample than the NLSY sample of 15-18-year-olds, since the 
latter sampK may have more siblings older than 18. 

Because the NI'.I.S had Dill v categorical data on parental education, 
we used dummy variables for charat terizing education for both par- 
ents. Ciender. race/ethnicity, single mother, mother's work status, 
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and region arc also all entered as dummy variables. Race/ ethnicity is 
coded as three mutually exclusive groups — black, Hispanic, non- 
Hispanic white. Mother's working status includes both full- and 
part-time work and the definitions varied slightly on each survey. On 
the NLSY survey, the question asked the mother's main activity when 
the child was age 14, whereas the NHI.S survey question asked about 
whether the mother worked full-time during the past week. 

Also included is a set of dummies to control for missing data in a 
number of fields such as income, parental education, age of mother 
at child's birth, family size, family type, and mother's work status. 1 
The set of missing dummy variables is somewhat different for the 
two datasets because the amount of missing data on given variables 
was different. This approach increased sample sizes in both sur- 
veys.- Hxplicitly controlling for the missing data allows us to see 
whether these individuals differ from the nonmissing cases in some 
systematic way. 

The weighted and unweighted means and standard deviations for 
both the NLSY and NHI.S samples are given in Table 5.2. The large 
differences in unweighted characteristics and mean test scores re- 
flect two factors, first, the stratification scheme is quite different for 
the two samples— the NLSY oversampled low-income whites and 
minorities, both of whom tend to have lower scores on standardized 
tests; the NHI.S oversampled private schools, many of which may 
have higher achieving students. Second, the NLSY was given in 1980 
and the NHI.S in 1988, and shifts in the distribution of particular vari- 
ables could have occurred over this time period. 



' We iurl tided missing value dummies tot , til eases with missing data bin only tut those 
vat iahles tut whit It i percent ot unite of the eases were missing data. I'.i each case, the 
missing value was replaced with the weighted mean ot the wniable lor all nonmissing 
eases. In the case ot missing paiental education, we substituted the education ol the 
utbei patent, whetlevci possible, and the weighted mean ol the variable itselt, 
uhenevei spouse education was missing as well. I 01 the \l I S, we also substituted 
student lepoited data tot missing patent data. I his proccduie was tollowed in all 
i ases. regardless ot whether the data were missing because the adult respondent in a 
two pan-lit household tailed to pi o\ide intoi mat ion about the othei patent or because 
uiilvone patent was present in the tatnilv. 

* \ sciisitnm anahsis was (lethiiu.i tl using unK the i a-.es with all data pieseut. and 
u sults weie substantial the same as ilmse obtain*' l In mi hiding missing data 
Utt Ml 'It's. 
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Table 5.2 

Means and Standard Deviations of the Analysis Variables: Weighted 
and Unweighted 
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The unweighted average vj-score in the NI-I.S sample is O.Oti for 
mathematics and 0.05 Cor verhal compared to (lie mean on the N'l.SY. 
which is about a third of a standard deviation below the mean. The 
average vj-score Cor the weighted samples is, of course, 0 bv construc- 
tion, with a standard deviation of I. The unweighted im nmo in the 
NIIS sample is fid pereeni higher than that of the NI.SY respondents, 
although the weighted means reflect a much smaller difference, Av- 
erage educational attammcnt is also considerably higher in the 
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NELS: Approximately 40 percent of mothers of the NF.LS eighth- 
graders have post-high school education compared to 15-20 percent 
of the mothers in the NLSY sample. The same disparity is evident in 
the father's schooling level. Family sizes are also significantly smaller 
in the NELS than NLSY, and there is a somewhat lower proportion of 
single parents in NELS. The proportion of mothers working does not 
appear to have changed much. The unweighted NLSY sample, by 
design, has a much higher proportion of minorities— about 40 per- 
cent, compared to the NELS, where only a quarter are black or His- 
panic. 

Before we present estimation results, we first present differences in 
simple test score means for different groups. Policy debates and 
popular commentaries on education and the family often use these 
simple differences between groups when advocating particular poli- 
cies. For instance, a great deal c. emphasis is given to the lower test 
scores of children in single-parent families. However, the size and 
relative magnitude of these effects can be quite misleading if other 
characteristics are not taken into account. A fairer comparison 
would be between students in single-parent households and stu- 
dents in two-parent households, who are otherwise similar in other 
characteristics. This is the advantage of multivariate models. We 
later compare the univariate relationship with multivariate results to 
contrast the differences. 

SIMPLE DIFFERENCES IN MEAN TES T SCORES FOR 
SELECTED GROUPS 

Figures 5.1 and 5.2 show weighted differences in mean test scores (in 
standard deviation units) for selected groups of the NELS and NLSY 
sample,. The two samples are very similar with respect to the direc- 
tion and relative magnitude of the effects of family characteristics 
on student test scores. The largest differences in both samples occur 
in children whose parents differ in educational attainment. For ex- 
ample, we find that children of college graduates score about a stan- 
dard deviation or higher on both verbal/reading and mathematics 
tests than children whose parents who did not graduate from high 
school. The next largest differences are between the racial/ethnic 
groups, with black students scoring 0.75 to 1.25 of a standard 
deviation lower on mathematics and verbal scores than non- 
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Hispanic white students, and llispanics scoring approximately 0.75 
of a standard deviation below non-Hispanic whites. 

Income, age of mother at birth of child, family size, and single- ver- 
sus two-parent family all appear related to student achievement. We 
find differences of approximately 0.20 to 0.50 of a standard deviation 
between the different groups in both samples. 

Children who come from households with a family income of 
$40,000 score 0.50 of a standard deviation higher on the N'l.SV and 
0.20 of a standard deviation higher on the NHl.S compared to chil- 
dren with incomes of $15,000. Children of older mothers (30 years at 
time of child's birth) score nearly 0.25 of n standard deviation higher 
on the NHl.S and 0.10 of a standard deviation higher on the Ni CSV 
compared to children of teen mothers (18 years at time of child's 
birth). Children with greater numbers of siblings do worse on tests 
by about 0.33 of a standard deviation on both samples. Children in 
households with single mothers score about 0.40 of a standard devi- 
ation lower on the NI.SY and about 0.25 of a standard deviation lower 
on the NF.l.S than children in two-parent households Children with 
working mothers versus those with nonworking mothers appear to 
score no differently on the NK1.S and slightly higher on the NI.SY. 
The patterns appear very similar for mathematics and verbal tests 
except for differences by gender, with girls scoring higher on ver- 
bal/reading tests on both samples. 

THE PROBLEM OP CONFOUNDING FACTORS 

To illustrate the point made earlier regarding the potential for erro- 
neous inferences that exists when looking at simple relationships, we 
use data from the NI.SY to examine the characteristics of households 
headed by single mot h( rs and two- parent households. The propor- 
tion of mothers without a high school diploma is much higher -in 
single-parent families than two-parent families (40 percent versus 25 
percent) and a much higher porporlion of them is black (33 percent 
versus 8 percent). In addition, their mean income is significantly 
lower— (SO percent lower than the mean in two-parent families. The 
lower achievement found in children living in single-patent house- 
holds could be due to these dillerences rathei than to the tac t that 
they are living with a single mother. 
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Because simple test score differences between groups can be mis- 
leading, (be next subsection presents tbe results of the multivariate 
model that estimates the relative net contribution of each these vari- 
ous factors, controlling for all other family factors. 

MULTIVARIATE RESULTS FOR ENTIRE SAMPLE 

The models presented here assume a simple linear relationship be- 
tween test scores and family and demographic characteristics. Sub- 
sequent reports w ill explore the effects of specifying more complex 
models that specifically test for nonlinearities in the relationships 
and for interactions between independent variables. We present the 
unweighted results in the main text. 1 

\LSY Regression Results 

fable ?■>.'.] presents the regression estimates for mathematics and ver- 
bal scores for all racial/ethnic groups. The regression coefficients are 
expressed in standard deviation units (or portions of one standard 
deviation) because the dependent variable in the regression is a 
-•-score. Thus, the coefficient of a given variable represents the effect 
of a one-unit change in the variable on the standardized test scote in- 
standard deviation units. Ill' me, parental education, age of mother 
al birth of child, number ol' siblings, working mother, and 
racial/ethnic variables all are statistically significant with respect to 
both the mathematics and verbal models. 1 

'v.hmu i. ms appeal in he simn'iviiai ilniilcil nn the appmpt Liienrss ut i iimlututiK 
■Ai'i^hli'il \risiis iiimrishlt'il legiessmns. I he gcni'Kil consensus is thai il the nnulel is 
iniunih s|U'filii'(l. ihi'ti umu'i^hiiHl ic^ii'ismns ,nr rtln nail iMuinuiie, I'lWi: 
I HiMunrhel and I Hun an, I'D) !: I t-i* el al , IMnp.. I ur tun sinipfe mutleK, ue I'Mimati-t) 
I will wi'ighU'd ami uimeiejiied it'UievatHts anil nmipaied the two, using I luMnm hcl 
ami Uuiu an's 1 1 *- ) i i ; 4 • pnui'dme. I heir ueie nn suhstaniiu' difU'icnn's hemren these 
it's;ii'ssiiiiis, c\i i'pi Idi ihr rll ens nl fan 1 and i'lh nil il\, uhirh wi'ic nun h stmnKi'i m 
ihr ueirjlled models. ,is ('\pci led. because nl s| lalllli alion nl die s.iniplcs. I til 
pii'dh live piupnscs. v\i- livid thai usiny tin- wri^hli'd cuellicieuis makes luilc 
ililli'ti'iit !• in ihr ti'siilis irptHiitl in Chaplei Six 

' In h'siinv, ihi' null In piithrsis dial ,i pai lii iil.ii i lu'ilii ii-nl is ii.it si^nilii aniK dilli'icni 
In mi n nni' ijsii.ilK usi's a i l iiu al I '. ,ilui' nl I ni, p n|i, I his is based i m llu' 
>.,,■>. nn n in, ilH i liutpuii'd s'amlaid i*i mis. w I m h assume ,i simple uniilnni sample 
liivlh .' Ms 1 ! ,mil die \lls .Hi- iiinliisi.ijy, sttalili.'d lamlutu samples and 
U'spnlldrllt- Irml In hi' in illistris, HhlUt lend In he homogeneous m ,i \,inel\ nl 
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Table 5.3 
Regression Results: NLSY 
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Adjusted H- »^H49 9.3595 

Income shows a strong positive relationship to student achievement. 
This relationship estimates that a $10,000 increase in income would, 
other things constant, incoase test scores by a little less than 0.10 of 
a standard deviation (0.075) or approximately 2.6 percentile points, 

The effect of mother':, education is both large and statistically signifi- 
cant. The relationship shows that having a mother who did not 



ways. I his means that the reported staftdaul ei rot s may be too small and the reported 
( statistics inflated, leauiug to incorrect rejection of the null hypothesis. 1 he ratio of 
the coii'Tt stand. nil eiioi to the uiinptlled siantla'tl prior is fnimn .is the design 
ellect and one needs to adpisl the nitiial l value upwaid In this design ellect. 
Although a single design ellect cannot be computed, a lough appioxinialion is 1 5 
giving us a critical t value nl appiosimateh .1.00. Although \\e repoit the unadjusted 
I -statistics lieie. the discussion hnplk illv uses a nifii al t- value ol .1.00. 
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complete liigli school lowers both mathematics and verbal scores by 
about 0.20 of a standard deviation compared to having a mother who 
completed high school; having a mother who lias some college or is ti 
college graduate increases the score by about 0.15 to 0.1b '/fa stan- 
dard deviation. 

The effect of father's education is somewhat larger than that of 
mother's education, even after controlling for mother's education. 
The relationship shows that having a father who is a college graduate 
versus one who is a high school graduate increases scores by about 
0.40 of a standard deviation for both mathematics and verbal 
scores — a large change that translates into a difference of about 14 
percentile points. Thus, these data indicate tha\ the education level 
of both mothers and fathers is important in accounting for test score 
differences. 

Our family size effects are quite large and statistically significant for 
mathematics and verbal scores. The results show that each addi- 
tional sibling lowers a child's achievement by 0.04 to 0.07 of a stan- 
dard deviation: an easier way lo understand this is to note that a 
child with two siblings will score about 0.10 of a standard deviation 
lower than a child with no siblings, family size appears to have 
stronger effects on verbal scores than on mathematics scores. 

We also find a significant positive relationship of age of mother on 
student achievement--with children of older mothers doing better 
on standardized tests. A child born to a mother who is 10 years older 
will score about 0. 1 0 of a standard de\ iation higher than a child u i ill 
a younger mother. 

"I he estimated model shows that children with working mothers — 
other tilings equal— score slightly higher scores by less than 0.10 of a 
standard deviation in both mathematics and verbal tests. Being in a 
single-parent household, holding. other things constant, shows es- 
sentially no effect on mathematics and verbal scores. This net effect 
is very different from the gross ellect reported earlier."' We interpret 

M In> (imli'i Is ins; .km ni ipi m: i Inn- k tli.it t'.r Ii.i* i 1 lulls is ml hiIIimIIih .ill rlui.u trust h s 
ot sinrjc p.ni'iii I, (inilic-. hi l. mull, 's \\ 1 1 1 v wmkiii)! nuiilicis ilmnij'Ji inn simple 
spei i lie. i Ik in It ihei e .lie nun ,nl mi i lei ms 1 11 i lnstei s i il u.iolispi ViiKle i li.li .It tei 1st lis, 
it ii,, is ssell tmi! iin lli.il the ellect ol belli}; liiinijjllt up in single- p.iuMtt hoiiseliulils m 
I H in si 'In i Ms ssilli si II 1.11 IV, Iliul I lets tn.1V ssell depend nil utliei i i if till 1st. I Ml es nut lulls 
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ihcse findings for working mother and single-parent family later in 
the report. 

Other things equal, the model shows that women perform better 
than men on bolh verbal and mathematics scores and the difference 
is over 0.10 of a standard deviation. Although women frequently do 
better than men on verbal /reading tests, the higher mathematics 
scores are a little surprising and may perhaps be explained by the 
emphasis on arithmetic computations in the ASVAB as well as the 
sample stratification, which oversarnpled minorities. On the whole, 
minority females tend to perform better than their counterpart males 
(Bock and Moore, 1984). 

The effects of race/ethnicity are significantly reduced in the multi- 
variate model but remain quite large and significant. Other things 
equal, blacks score about 0.50 of a standard deviation below non- 
llispanic whites (about 17 percentile points) and Hispanics score 
about 0.20 of a standard deviation (or 7 percentile points) lower than 
non-Hispanic whites. The results are consistent for both mathemat- 
ics and verbal scores. 

Other things equal, children in the Northeast and Midwest tend to 
perform better than children in the South. This may reflect school 
effects or cultural effects or some combination of the two. 

NELS Regression Results 

Table 5. I presents the estimation results from the XF.l.S. Overall, the 
pattern of results is similar to that found in the NI.SY, in terms of di- 
rection and relative magnitude of effects, although some of the coef- 
ficients d'ffei m magnitude. Income, education of both parents, age 
of mother, family si/e, and racial/ethnic variables all have similar 
signs am) are statistically significant in \H1.S as well. The mathemat- 
ics am! reading models are quite comparable across the two datasets. 
For example, we find that family size has a stronger effect on verbal/ 
reading scores than on mathematics scores— a result that holds lor 



, .ijitmi'd l>\ Ihr Minpli' Ihu .ii -\nn Mm ,iih>ii itsotl heir I rn example, the I'Ui-rl <il hrhn; 
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Table 5.4 
Regression Results: NKLS 
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both the NISV arid the NHLS samples. Living with a single moiher is 
insignificant in both models and both datasets. 

The relative contributions ol' ineome and parental education to stu- 
dent achievement are somewhat different in (he models estimated 
from the XI.SY and NKI.S. I'or example, the income effect in the 
Nbl.S model is reduced by more than one-half compared to that in 
the NI SI' model. On the other hand, the effect of having a mother 
wuh a college degree relative lo the omitted category (mothers with 
high school diplomas) in the XI I S is more than double what we had 
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found in the Nl.SV, whereas the* effect of having a faiher wit h a col- 
lege degree is much larger. 

The negative effect of family si/.e is reduced (by almost half) in the 
XKLS. perhaps because there is not as much variation in family si/.e 
in the Ni l .S as in the \1.SY. The effect of the race/ethnicity variables 
is also stronger in the NIILS compared to the Nl.SY model, although 
the difference is not as large for blacks. For llispanics, ibis may be 
because immigration over time has substantially changed the char- 
acter of the Hispanic population and the more recent immigrants 
may be more constrained by their environment than were earlier 
immigrants. 

Summarizing these differences, we find that in the N'l-l.S models, 
ram pa red to the NI.SY, economic factors and family size arc less 
strongly related to student achievement, whereas the effects of 
parental educational attainment and race/ethnicity (at least for 
mathematics) are stronger. 1 ' 

We can suggest several reasons why coefficients are likely to differ 
across tin- two datascts. first, it may be that the overall strength of 
family effects and the relative strength of the individual famih vari- 
ables change with the age of the child. Overall, one w ould expect the 
relative ellects of family variables to decline as the child gets older 
anil is exposed to more schooling and more influence outside the 
famih tf'lnmin. 19H(i). 

Second, the diflcrcnces might be due to the presence of nonlinear or 
interactive ellects for family variables. Because of the very different 
samples, the estimated coefficients could be biased in different ways. 
Such biases might arise from the nonlinearities and interactive ef- 
tecis lor the two samples because ot the extremely different stratifi- 
cation used. For instance, if family size has a nonlinear effect, then 
the large dillercnce in average family si/.e between the two samples 
would appear as changes in the linear coefficients.' 

''I 111' I ll'sl H'|IH Is I til ■ ll\ |llillll'sls ill I'qn.liiU III lllr lull sl'lsnl I ul'l III f 1*1 >;■. I 111- 

i miipuleil I is 'Hi In; ihr ui.uh nimlil .mil II 7 Ini the wih.il imnli4. I It*- null 
III [iiiltu Ms ii| i-i;ua!ij\ nl • i n • 1 1 1 1 1 1 - 1 1 ! . !ih ihr ', V, ,u„| Ml'. , ,m llii'ii'loir. Iir 
H'ti'i nil ,il I hi" M Hi li'U'l 
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Third, the underlying structural relationship may well have changed 
between 1980 and 1988, the time period spanned by our two 
datasets. For instance, the weaker role of income in the later study 
might be explained if quality differences among schools decreased in 
the laier period and the role of income in allowing families to move 
to better school districts became less important." 

Fourth, some effects may be caused by differences in the tests them- 
selves. For example, the stronger effect of race/ethnicity in 1988 in 
the mathematics model might well be an artifact rather than an un- 
derlying structural change in the coefficient, caused by differences 
between the NF.LS mathematics test and the mathematics segment 
oftheASVAR. 

Comparing Univariate and Multivariate Results 

It might be useful to reexamine the statement we had made earlier 
that simple group differences can potentially be very misleading. We 
are now in a position to examine more closely the gross versus net 
effect of particular family characteristics. We do this by comparing 
the simple test score differences for selected groups of children with 
the test score differences that would exist if the children had other- 
wise similar characteristics but differed in this one variable alone. 
These latter effects are predicted from the multivariate models dis- 
cussed above. Figures 5.3-5.0 show the results of such comparisons 
for the four tests under consideration: N1.SY mathematics, NM.SV 
verbal, NF.l.S mathematics, and NF1.S reading tests. 

We find that overall the net effects tend to be much smallei — less 
than one-half of the gross effect. This is not surprising given that the 
net effect controls for the effect of other variables and the gross effect 
take into account both the characteristic under consideration and all 
the other characteristics that vary with it. The pattern — the overall 
importance of effects on test scores — remains much the same, how- 
ever. Where earlier we had seen differences of over one standard 
deviation between the test scores of children whose parents did not 

VVc |]\pnllu'M.'t'il '1],u |Mit ol ilu- chlSeii'ii! is ht'lut'cn 1 1 if two models nii|jlil lit' tlur 
to llic owr'-.iniplinj; ol b!.u ks ,m<l UNjwmrs in '.he M SY llmvrvci. lite unbilled 
ri'i;u'v,ioTi>« sliovv Mii'ikn iliJU'ri'llri"*. so tins k not likcK tin' i .iw 



10 / 



H4 Student Achievrnvnt and ihe (. hanging AnH'riran Rimily 



Mathematic 



Mother's educate 

.Coi'ege vs non.h.gSsc^oo 
Father's education 

Income .jck-.s -.ski 
Female 

Working mother 

Mother's age at birth 

i: 'p 

Siblings ' 
Single mother 
Hispanic vs white 
Black vs white 




| Group differences 
□ Controlled group 
differences 



■1 25 -1 -0 75 -0.5 -0.25 



0.2 0. 
5 5 

Standard deviation units 



0.7 



1 1 25 



Figure 5.3 — Unadjusieci Versus Net Differences in Mean Mathematics Test 
Scores for Selected Groups, Nl.SY 



Verbal 



Mother s education 

Father's education 

Income -'ok .s 'M\ 

Female 

Working mother 
Mother's age at birth 

.1": v- if 

Siblings -t »<, • 
Single mother 
Hispanic vs white 
Black vs white 




H Group differnnces 
LJ Controlled group 
differences 



-1 25 -1 -0 75 -0.5 -0 25 0 



0.2 0 
5 5 

Standard deviation units 



0 7 



1 1 25 



f igure fi.-l Unadjusted Versus Net Differences in Mean Verbal l est 
Scores for Selected Groups, Nl.SY 



o 

:RIC 



Mullivarialt' Analysis of Achievement Scores (>.") 



Mathematics 



Mother's education 

cvgevs r'o'i-^qh-scnoci' 

Father's education 

Income .-son v% isk< 

Female 

Working mother 
Mother's age at birth 

Siblings v- < 
Single mother 
Hispanic vs. white 
Black vs. white 




■ Gioup differences 
I I Controlled group 
differences 



_L 



-125 -1 -0.75 -0.5 -0.25 0 0.25 0 5 0.75 1 1 25 
Standard deviation units 

Figure S.fi — Unadjusted Versus Net Differences in Mean Mathematics 
l est Scores for Selected Grouns, NHJ.S 



Reading 



Mother's education 

Father s education 

Income. : , ' k 

Female 

Working mothei 
Mother s age at birth 

Siblings i ." ■ 
Single molnr-' 
Hispanic vs wliile 
Black vs while 




| Group differences 
□ Controlled group 
differences 



_L 



_L 



-1^5 -1 0 75 -0 5 -0.25 0 0.25 0.5 0.75 1 1.25 
Standaid deviation units 



f igure 5. (i- -Unadjusted Versus Net Differences in Mean Heading 
l est Scores for Selected Groups, N'MI.S 



lily 




(if) Student ,-\dti<>vi'tlu>m anil the Changing American I'amily 



have a high school diploma and the test scores of those whose par- 
ents were college graduates, we now predict differences of between 
one-quarter and one-half of a standard deviation, which, while large, 
are not as large as the unadjusted effects. 

In particular, notice the effect of being brought up in a female- 
headed household. The effect is essentially zero, very different from 
the 0.40 difference seen earlier. Apparency, a lot of the gross differ- 
ence is indeed due to income, low maternal education levels, and 
other factors that frequently characterize single-parent families 
rather than family structure itself. The family effects show that a 
child with four siblings will score about 0.20 of a standard deviation 
lower on the verbal/reading test and 0.10 lower on a mathematics 
test than a child with only one sibling. The differences by 
race/ethnicity are still quite large but considerably smaller than the 
gross effect. 

Essentially, we see the same patterns for both mathematics and ver- 
bal score differences and for the N1.SY and NH1.S samples. 

Using gross effects almost always overstates the effect of a variable 
and in some cases implies an effect that disappears for the controlled 
comparisons. Thus, use of gross effects for advocating policies on 
positions can be very misleading. 

INTERPRETING THE RESULTS FOR WORKING MOTHERS 
AND SINGLE-PARENT FAMILIES 

The effects of single-parent families and working mothers need 
careful interpretation The effects of the other family and demo- 
graphic variables— income, parental education, family size, age of 
mother at child's birth, and race/ethnicity— in the analysis are ex- 
pected and fairly consistent with a long line of research. However, 
when considering the effects of single-parent families and working 
mothers on student achievement, we find that the evidence is mixed. 
It is important, therefore, to place our results in perspective, to high- 
light their limitations, and to determine the extent of bias in these 
coefficients. 

We find an insignificant effect for single parents in both datasets. l-'or 
working mothers,' we find an insignificant coefficient in one and a 
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small, positive, significant coefficient in the other. These results mir- 
ror the mixed findings in the literature cited earlier and- are consis- 
tent with recent work using different sources of data. For example, 
Hill and O'Neil (1992) use the child supplement from the Nl.SY to es- 
timate regressions on test scores for 3-6- and 6-9-year-old children 
and find similar insignificant effects for single-parent and working- 
mother variables once other family factors are taken into account. 
With data from the General Social Surveys from 1974-1990, Alwin 
(1991) finds insignificant effects of single parents and working moth- 
ers on verbal scores when controlling for other family measures. 

However, for several reasons one needs to be cautious when inter- 
preting these null or small significant effects. First, when single fam- 
ilies are created by divorce, there are usually changes in other family 
characteristics as well — most notably family income. For instance, 
average family income significantly declines. So the full effect on test 
scores of the increase in the number of single-parent families is re- 
flected through a drop in family income as well as a change in the 
family structure from a single to two parents. The results suggest 
that after taking account of these changes aiu' other measured dif- 
ferences between single- and two-parent families, we would find no 
significant added effect on test scores simply from the difference in 
family structure between single- and two-parent families. However, 
even this interpretation needs more precision. 

A second important consideration is that there might be unmeasured 
differences in single-parent or working-mother families that may not 
be reflected in our models. Perhaps the best example is that single- 
pal ent families most often result from divorce, and divorce can be 
preceded by a eonflictual family environment, which research shows 
can be very detrimental to children's development (Demo and 
Acock, 19HB; Demo, 1992). This introduces the possibility that the 
coefficient reflects the unmeasured characteristics as well as the 
variable itself. Thus, the absence of an average effect of being in a 
single-parent family on test scores — other things equal — might re- 
flect the fact that for youth in many of these homes, prior conditions 
may have been detrimental to achievement. This implies that the re- 
sult should not be generalized across all families. In simpler terms, 
some children living with a single parent may be better off than those 
living with two parents who are in conflict, 1 lowever, the results do 
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not imply that childen in nonrontlirtual two-parent families would 
he equally well off in a single-parent family. 

Third, perhaps the most important consideration is that the effects of 
working mothers and being in a single-parent family may vary con- 
siderably depending on the family context. These effects are likely to 
differ by family size, by educational level of parents, or by income 
level. Thus, an insignificant coefficient for working mothers or single 
parents may well hide offsetting strong positive and negative effects 
in different types of families. 51 However, our results provide some 
evidence that, when looking at average effects across all families, nei- 
ther the potential positive nor negative effects of working-mother or 
single-parent families dominate. This again means that the results 
cannot be generalized to all types of families. 

.An important limitation of our analyst.; is that we measured maternal 
labor-force participation and family type when the child was approx- 
imately 14 years old. This does not account for whether the mother 
was working at younger ages or how long the single- parent status 
existed. It may be important to distinguish between children who 
have been in single-parent families from birth and those who have 
lived a significant part of their life in a two-parent household. In the 
latter case, the level of family income may have been much higher 
during a portion of the child's life, and the current family income 
may be a poor proxy for the family resources available earlier. 

REGRESSION RESULTS BY RACIAL/E THNIC GROUP 

We had seen earlier that the race/ethnicity dummy variables were 
large and statistically significant in our total regressions. Introducing 
race/ethnicity by means of dummy variables presupposes that the 
achievement process for blacks and llispanics does not differ from 
that for non-Hispanic whites other than in the constant term. How- 
ever, to test more precisely this assumption of equality across the 
three groups (blacks, llispanics, and non-1 lispanic whites), we esti- 
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mated separate regressions tor each and then used an F-lest to test 
lor stability of the coefficients across the groups. 

Table 5.5 provides the unweighted means of the analysis variables 
for the three groups for both the NI.SY and the NKLS datasets. 10 As 



Table 5.5 
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is clear from the table, family characteristics differ markedly across 
the three groups. Hispanics and blacks tend to have much lower in- 
comes (about a third lower in the NLSY sample, and about 45 percent 
lower in the NHLS sample) than non-Hispanic whites. Hispanics and 
blacks also trail non-Hispanic whites in terms of parental educa- 
tional attainment. Over three-quarters of Hispanic mothers in the 
NLSY sample and 45 percent in the NHLS sample did not have a high 
school diploma. The same trends are evident with respect to father's 
educational attainment. Family size also differs across the groups, 
with non-Hispanic whites having the smallest family size, although 
the differences have narrowed considerably by 1988. the time when 
the NHLS data were collected. The proportion of single mothers is 
higher among the minority groups in both samples. The regional 
pattern reveals that the largest proportion of blacks live in the South, 
whereas Hispanics are concentrated in the West. 

In general, the model results for the three groups show similar pat- 
terns as the total sample regression in terms of signs, hut somewhat 
lower significance for the smaller minority samples. However, the 
sizes of the coefficients of some variables differ across the three 
groups, and in general, these diflerences hold across both the math- 
ematics and verbal/ reading equations. 1 1 

Regression Results by Racial/Ethnic Group: NHLS 

We discuss the NHLS results first because the sample sizes for the 
minority groups are significantly larger for the NHLS than tor the 
NLSY and the pattern of differences is clearer. Tables 5.6 and 5.7 pre- 
sent the results of estimating separate race/eilmicity regressions for 
the mathematics and reading models for the NHLS sample. 

Mathematics Model. The magnitude of the income coefficient tends 
to be much greater and that of the parental education coefficients 
much smaller for the minority groups compared with the non-His- 
panic white group. The effects of age of mother are fairly 
similar across all three groups, but family size becomes small and 

1 1 I he I Irsl lvt\ lni hinilllgl'tiem ill ' nrltiui'llls .11 ti">s lln- 1 1 lire S'.Htnps \\.t"« H')i'l It'll 
ill Ihl' lUH level. I lie I'nmputeil I MaliMii s weie \en l,ilf;e ,11 7<> lni I lie 111. till llliuli'l 
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Table 5.6 

Regression Results by Race/Ethnicity, Mathematics Model: NEl.S 
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insignificant for the black sample. The effects of single mother and 
mother working tend to be small and insignificant for all groups. The 
regional variables tend to show different effects for the three groups. 
The Northeast and Midwest variables tend to be large and positive 
for non-Hispanic whites, with the South being lowest, The black 
sample shows no significant regional effects, whereas the Hispanic 
sample shows negative but insignificant effects for all regions but the 
South, 
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Tabic 5.7 

Regression Results by Race/Ethnicity, Reading Model: NELS 
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Reading Model. The reading model results, with some specific ex- 
ceptions, ;tre quite similar to the mathematics model results. 1 -' The 
patterns for income, education, age of mother at child's birth, and 
family size are all similar to those noted in the mathematics model. 
The effects of single parent and working mother are small and in- 
significant, as in the mathematics model The regional patterns are 
similar hut less pronounced for the non-1 lispanii whites. Unlike in 
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the mathematics model, blacks display a regional pattern similar to 
that of non-Hispanic whites. 

The Hispanic regional coefficients show a similar pattern to those of 
the mathematics models, with negative coefficients for all regions 
except the South. However, the verbal equation has a somewhat 
larger negative effect for the West and a smaller negative effect for 
the Northeast. 

Regression Results by Racial/Ethnic Group: NLSY 

Mathematics Model. Tables 5.8 and 5.9 show the regression results 
by race/ethnicity for mathematics and verbal test scores for the NLSY 
sample. The distinct patterns on education and income noted for 
the NH1.S dc .tot show up in the NLSY sample In general, the size of 
the inconi' coefficients show much more similarity in the NLSY than 
in the NHLS sample. However, the parental education coefficients 
show a more pronounced effect for the non-1 lispanic whites than for 
minorities — similar to the NI-'l.S. The age of mother at child's birth 
and family size variables show somewhat stronger effects for non- 
I lispanic whites than for either minority group. Mother working also 
shows a statistically significant positive effect for noii-1 lispanics but 
insignificant effects for minority groups. Single mother is insignifi- 
cant for all groups. The regional patterns of the NLSY for the His- 
panic and non-1 lispanic groups are similar but more pronounced 
than those ol the NI-'l.S. 

Verbal Model. The effects of all four main family variables — educa- 
tion, parental education, age of mother at child's birth, and family 
size — are similar across groups in the verbal NLSY model. The coef- 
ficients of single mother are small and insignificant across all groups, 
whereas the effect of mother working is again positive and significant 
lor non-1 lispanics. Regional patterns are also similar to the mathe- 
matics model, w ith minor exceptions. 
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Table 5.8 

Regression Results by Race/Kthnicity, Mathematics Model: NI.SY 
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SUMMARY 

The results from the N'l.SV and NI-I.S models arc substantively simi- 
lar in the direction and relative significance of family and demo- 
graphic characteristics for both mathematics and verbal/reading 
abilities. We find that family income, parental education, age of 
mother at child's birth, and number of siblings all have statistically 
significant effects on student achievement and are in the expected 
direction. The effect of working mother is positive but small. Family 
structure (single-parent versus two-parent families) is insignificant 
in both the N'l.SY and NF.I.S models, after controlling for other vari- 
ables, 
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Table 5.9 

Regression Results by Race/ Ethnicity, Verba! Model: NLSY 
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There arc some clitTerences between the Nl.SV and NHLS results. We 
find that in the NHLS models, compared to those of the NLSY, family 
income and size are less strongly related to student achievement, but 
the effect of parental educational attainment and race/ethnicity (at 
least for matlv-matit i is stronger. These differences maybe partially 
explained by the differences in the tests given to the two samples, the 
sampling design, the age spans of the sampled children, and the time 
period. 

In addition to regressions tor the total or pooled sample, we fit sepa- 
rate models by race/ethnicity — blacks, Ilispanics, non- Hispanic* 
whiles, hi both the N'l.SYand NITS, the effects of family characteris- 
tics on student achievement do not differ substantially across the 
three groups from what we found in the model fit lo the pooled 
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sample, although, in general, income appeared to be more important 
for minorities than for non-Hispanic whites, and parental education 
somewhat less so. The effects of single mother and working mother 
are generally small and insignificant across all models, although we 
remain cautious about interpreting these effects too literally without 
further exploration of interaction terms and nonlinearities in the 
model specification. We mentioned above that the effects of family 
structure and maternal labor-force participation may well differ, de- 
pending on other family circumstances and environment. 



Chapter Six 

ESTIMATING THE EFFECTS OF CHANGING FAMILY 
AND DEMOGRAPHIC CHARACTERISTICS 

ON TEST SCORES 



In this chapter we first review the methodology used in predicting 
test scores tor samples of young people selected from the CPS files 
and the assumptions underlying that methodology. We then present 
differences in estimated mean test scores based on the distributions 
of predicted test scores for 1970-1990 and for 1975-1990; these dif- 
ferences represent our estimates of the effects of changing family and 
demographic characteristics on student achievement. We calculate 
test scores for verbal/reading and mathematics using the NHLS 
equations for 13-14-year-olds and the NLSY equations for 15-18- 
year-olds. We use two different equations to calculate test scores for 
the three racial/ethnic groups, based on what we referred to earlier 
as the "pooled" and "nonpooled" estimates. The former controls for 
race/ethnicity by dummy variables and was fit to the full sample 
from the NLSY and the NF.LS; the "nonpooled" estimates are derived 
by fitting separate regressions to the samples of blacks, llispanics, 
and non-Hispanic whites. 

ESTIMATING EFFECTS USING THE CPS SAMPLE 

Three important assumptions underlie our methodolog\ : 

• struc tural changes in model coefficients over time are small; 

• the estimated coefficients for the family variables would not 
change appreciably if nonfamily variables were included in the 
moch Is; and 

• cross-sectional estimates of coefficients can accurately estimate 
the effects of lime series changes in the independent variables. 
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The first assumption implies that models fit to data collected from 
representative samples of similarly aged students in 1970 and 1990 
would produce fairly similar coefficients (see Appendix A for a dis- 
cussion of this assumption). This assumption could he tested if we 
had data on family characteristics and test scores of representative 
samples of similaily aged youth at two points in time. Then the shift 
in structural coefficients could be estimated, as discussed in 
Appendix A. and precise estimates of the effect of family and demo- 
graphic characteristics on test scores could he made. 1 

The NT.I.S and XLSV samples represent data that are eight years apart 
but cannot he used to estimate shifts in coefficients because of the 
different age groups, stratification, and tests given to the samples. 
Karlier. we showed that there are differences in the models fit to the 
two dataM'ts. and to some extent these differences may reflect 
structural changes in the coefficients over time. However, despite 
the differences in the models, we find the overall predictions to be 
rcmarkahh similar, suggesting that, at least for purposes of estimat- 
ing I'amiK effects, the differences may not be that important. 

The second assumption is that the family coefficients that would be 
estimated from a fully specified and estimated model would be simi- 
lar to those that include lamilv effects alone. Preliminary evidence 
with estimating models including school and community factors 
shows little change in lamily coefficients. 

fhe third assumption, common to most models based on cross-sec- 
tional data, implies that cross-sectional coefficients are similar to 
coefficients estimated from pooled time-series/cross-sectional data 
(if such data were available). (Toss-sectional coefficients can differ 
because they measure long-term effects, whereas coefficients 
emerging from time-series analysis include both short- and long- 
term effects, lu general, it is difficult to make predictions regarding 
ihc direction and magnitude of such bias (Kith, 1959). 

' \ test nl i Ins lu|inilu«N|s \wl) l»r possible when <he I'IMJ Senini M is s.imple liwiimis 
■n.iil.ihle. It i ,m he i ismp.ttetl to the IH7L' Seiuoi silinplf ot ill' 1 High School and 
!li A find Sfi\,.\ I lo'Ai'wi. i-uni picli mi nan ev iilelue lioin a i oinp.ii isim of tilt' I 'Kill 
,iiul I'lnti liij'.li Silmul .mil Hi'Uiml Siiivi'V .mil M IS Sopluminie s,unple shows no 
-i, hi .in ,itt\ ■ i".i 't)i .nit i li.iniv in si s \ ,ii kiIiIcs hetvu i n lltc-i' samples ili.ishisU el ,il . 
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These assumptions enable us to use our estimated equations to pre- 
dict test scores for samples of children, based on their family and 
demographic characteristics. We used the March Current Pop- 
ulation Surveys to select 14-18-year-olds in a given year: 1970, 1975, 2 
and 1390. Second, for each child in the sample, we linked their 
record to family records that captured family characteristics for the 
selected sample. These characteristics included race/ethnicity, 
gender, age of mother at child's birth, parental educational attain- 
ment, total family income, type of family (single versus two parent), 
mother's employment status, family size, and regional variables. 
Third, we used the equations from the overall NLSY and the NELS 
models to predict a test score for each child on the CPS files, based 
on that individual's own family characteristics. We use the NLSY 
model to predict scores for 15-18-year-olds and the NKLS to predict 
scores for the 14- 1 5-year-olds. :i 

For the longer time period (1970 to 1990), we were able to identify 
only two racial groups: black and nonblack. Therefore, for these 
predictions, the full model was estimated on the pooled sample, 
omitting the Hispanic variable and grouping the l lispanics with the 
non-Hispanic whites. This provided the pooled estimates. Separate 
regressions were fit for blacks and nonblacks — these are the non- 
pooled estimates. 

Next, we predicted test scores for 1975 and 1990 for the three 
racial/ethnic groups, using both the pooled (with the Hispanic vari- 
able) and nonpooled estimates (fit to the three groups separately). 

This allows us (a) to examine the results separately for the three 
groups and (b) to compute a weighted overall predicted test score 
using these separate regression coefficients to see whether this dif- 
fers from the one predicted by the total pooled prediction equation. 



-We chose 1 'ITS because tite identification of I Ih-patlies as a separate group did not 
begin until alter 1970. Thus, all prediction-* by race/ethnicity are for the years I97!i 
and 1900. although the predictions lor the total sample and lot blacks and nonblacks 
are lor the years 1970 and 

•'The weighted age distribution ot the eighth graders on MIS showed that 
PI roximati'ly 9~> peri em ol them were U \'i veais old in the spring of 19HK. We. 
ilierelore, restricted out prediction samole hum the ( I'S to hi- 1 Vycat -olds to more 
closelv match the Nl-.l S sample. 
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ESTIMATES OF FAMILY AND DEMOGRAPHIC EFFECTS 

Using the Pooled Sample Model: 1970-1990 

Figure 6.1 shows the estimated difference in the weighted mean ver- 
bal/reading and mathematics test scores (in standard deviation 
units) for 15-18-year-olds (based on the NLSY model) and 14-15- 
year-olds (based on the NBLS models) from 1970 to 1990 as a result 
of changing family and demographic factors. We estimate a gain in 
mathematics test scores of 0.20 of a standard deviation or an increase 
of about 7-8 percentile points for both age groups. The estimated 
verbal gains are slightly higher than the mathematics gains (0.25 of a 
standard deviation) for the 15-18-year-olds, although we predict the 
same gain in reading for the 14-15-year-olds as in mathematics. 

The estimated gains in test scores are somewhat surprising, given the 
conventional wisdom that the I'amily environment has become 
steadily worse for children. I lowever, the results are explained when 
we examine the changes in family and demographic characteristics 
that occurred between 1970 and 1990 for young people aged 15-18 
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Figure 6.1 — Change hi Mean Predicted Test Scores Using Estimated Overall 
Family ami Demographic Effects ami Pooled Regressions, 1970-1990 
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(derived From (lie CPS data) and the strength and significance of the 
variables in the achievement equations. ■' 

Table 6.1 illustrates graphically how we compute the total net effect 
of changes in selected family characteristics on predicted test scores 
from 1970 to 1990. The net effect of all these changes in family and 
demographic characteristics is an estimated gain in test scores over 
this time period primarily as a result of better educated parents and 
smaller family size. 

Table (i.2 presents selected family characteristics for children aged 
15-18 in 1970 and 1990. As can be seen from the table, two 
important trends favor higher achievement — the substantial changes 
in the educational attainment of both fathers and mothers of 
adolescents between 1970 and 1990, and the decline in family size. 
For example, approximately 40 percent of parents had less than a 
high school education in 1970; this was true of fewer than one-fifth of 
the parents in 1990. Conversely, the proportion of mothers with 
some college or a college degree more than doubled over this time 
period, increasing from 17 percent to 'Mi percent; for fathers, the 
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Table 6.2 

Selected Family and Demographic Characteristics of 15-18-Year-Olds, 

1970-1990 
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increase was from 25 percent in 1970 to 43 percent in 1990. 
Similarly, there were marked changes in family size over this time 
period, with smaller families having one to two children becoming 
more the norm than was previously the case. l ; or example, the 
number of children with one or no siblings increased from 48 
percent in 1970 to 73 percent in 1990; the proportion of children with 
four or more siblings declined by over 75 percent. 

These factors are primarily responsible for the estimated gains, but 
other factors had small effects. The proportion of children with 
working mothers increased by about 40 percent and income in- 
creased very slightly from 1970 lo 1990 by about 3 percent; each 
makes small positive contributions. However, the small gain in 
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family income reflects several influences. Income for men— 
especially younger men — has generally declined in real terms during 
this period, Family income has been maintained by more mothers 
working. Another influence on the average family income is the 
formation of more single-parent families, which often experience 
income declines in a transition from a two- to a single-parent 
household. 

However, other trends have less favorable effects on achievement. 
For example, there is an increase in the number of young mothers, 
from 9 percent in 1970 to 13 percent in 1990; this had a small nega- 
tive effect on test scores. The proportion of children living with sin- 
gle mothers increased by almost 65 percent over this time period, 
although the net estimated effect of (his variable was seen to be 
rather small in (he models presented earlier, in our methodology, we 
take account of the increase in single-parent families partially 
through the family income variable. Presumably, if the number of 
single-parent families had not increased, family income would have 
shown stronger gains. 

In addition, the racial composition of children changed as the pro- 
portion of blacks increased by about IB percent. This demographic 
shift — other things equal — would tend to lower scores. 

Predicted Changes in Test Scores by Race, 1970-1990 

There is considerable interest in how black children have performed 
over time and whether the gap between blacks and nonblacks lias 
widened or become smaller. Figure (i.2 shows estimates of separate- 
family effects for blacks and nonblacks using the pooled equations. 

The black estimates show tfivtittr gains as a result of changing family 
factors in liaili mathematics and verbal scores over this, time period 
for both age groups compared to (hose for whiles. Using (he NM.SY 
model, we estimate a gain of over 0.30 of a standard deviation in 
mathematics and 0.40 of a standard deviation in verbal scores for 
blacks, compared to 0,20 of a standard deviation in mathematics and 
about 0.25 of a standard deviation in verbal scores for nonblacks. 
I hi> \FI S estimated differences are somewhat smaller than those of 
the Nl SY more on (he order of (1.0(5 0.09 standard deviation units. 
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Figure B.2— Differences in Moan Predicted l est Scores by Race, 1970-1990 



One reason for this differential gain between blacks and nonblacks is 
shown in Table 6.3, which compares changes in black and nonblack 
families of 15-18-year-olds between 1970 and 1990. Black family- 
characteristics show even more favorable changes than those in non- 
black families in the two key areas of parental education and family 
size. 

For example, although the proportion of black mothers with some 
college increased threefold from 7 percent in 1970 to 25 percent in 
1990, the increase among nonblack mothers, although still substan- 
tial, was smaller. The same trend is evident among fathers as well. 
The proportion of black fathers with some college or a college degree 
increased by almost 300 percent, from 6.5 percent in 1970 to almost 
25 percent in 1990, whereas the proportionate increase among non- 
black fathers was about 70 percent. The other large contributing fac* 
tor is the marked decline in family size among blacks. The number of 
children in small black families increased over 100 percent in this 
time period compared to a 45 percent increase among nonblack chil- 
dren. 
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Table 6.3 

Profile of Black and Nonblack 15- 18- Year-Olds, 1970-1990 
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However, two oilier possible reasons for the black/nonblack differ- 
ences are use of pooled equations, which assume that black and 
nonblack coefficients are the same (with the exception of a shift in 
the constant term), and the inclusion of I lispanics with the nonblack 
sample."' The continuing immigration of Hispanic families could be 
a factor in lowering the gains of nonblacks. To test these hypotheses, 
we calculated test scores using race-specific equations for black, 
1 lispanic, and non-1 lispanic whites for the period 1 5175-1 {MH). 
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Estimates for Black, Hispanic, and Non-Hispanic Whites, 
1975-1990 

Figure 6.3 shows the nonpooled estimates for family effects for 
blacks, Hispanics, and non-Hispanic whites between 1975 and 1990. 
For 15-18-year-olds, we predict a gain of about one-quarter of a 
standard deviation in mathematics and verbal scores for non- 
Hispanic whites; a gain of 0.15 in mathematics and 0.25 in verbal for 
blacks. Hispanics show the smallest predicted gain, only 1 /20th of a 
standard deviation in both mathematics and verbal scores. The 
gains predicted for the 14-15-year-olds have similar patterns across 
groups but are somewhat smaller for all three groups compared to 
the NLSY predictions. 

The results indicate that some of the black/ nonblack results were 
due to the influence of the expanding Hispanic population as well as 
the use of pooled models. When we separate Hispanics from the 
nonblack population, the largest family effects are for the non- 
Hispanic white group except for tiie NLSY verbal results, where 
blacks and non-Hispanic whites show identical gains. 
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Figure 6.3— Change in Predicted Moan Test Scores by Race/ Kthnirify Using 
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The much smaller Hispanic gains, estimated by our equations, can 
be understood by looking at the changing characteristics of Hispanic 
families shown in Table 6.4. 6 Because of the influx of new immi- 
grants, most of whom are somewhat less educated and less skilled 
than previous immigrants, Hispanic families do not exhibit the large 
gains in parental education that black families do over this time 
period. In addition, income declined in real terms by about 12 
percent, and the proportion of young mothers also increased by over 
40 percent. On net, these changes in family characteristics would 
have a marginally positive effect on test scores but much smaller 
than those for black and non-Hispanic white families. 

Table 6.4 

Selected Family Characteristics of Hispanic 15-18-Year-OIds, 1975-1990 



Variable 


1 975 


1980 


1990 


% Change 
(1975-1990) 


Income ($1987) 


29.750 


30,405 


26,073 


-12 


Mother's education 










Less than high school 


63.9 


60.5 


54.6 


-15 


High school 


26.4 


27.2 


29.8 


13 


Some college 


5.7 


7.7 


10.9 


91 


College graduate 


3.9 


4.5 


4.6 


18 


Father's education 










Less than high school 


61 .9 


58.7 


55.3 


-11 


High school 


22.0 


24.4 


25.6 


16 


Some college 


8.3 


9.9 


12.2 


47 


College graduate 


7.11 


7.1 


6.9 


-12 


Number of siblings 










0-1 


.'19.5 


43.7 


54.3 


37 


2-3 


.14.2 


36.7 


37.3 


09 


4 or more 


26.3 


19.6 


8.5 


-68 


Age of mother at child's birth 










< 19 years 


11.7 


12.3 


16.7 


43 


20-24 years 


29.4 


32.9 


34.4 


17 


25-29 years 


29.5 


27.6 


27.6 


-06 


>3() years 


29 4 


27.2 


21.3 


-28 


Single mother 


23.9 


21.fi 


32.1 


34 


Mother working 


38.9 


46.3 


55.0 


41 



''Again, as before, we show the changes in tamily characteristics lor Hispanic youth 
aged 14- 15 -years-old in fable B.3. The trends are very similar for the two groups. 
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SUMMARY 

The regression coefficients presented in the last subsection were 
used to predict mathematics and verbal/reading test scores for 
samples of children from the Current Papulation Surveys for selected 
years. We then computed the mean for each of these predicted test 
score distributions. The change in the means of the predicted test 
scores represents our estimate of the effect of changing family and 
demographic characteristics on test scores over the relevant time 
period. 

We find, overall, that we would predict a gain in average test scores 
from 1970-1990 of about 0.20 of a stand ird deviation for both math- 
ematics and verbal/reading tests. This h largely due to net positive 
changes in the family environment over this time period, predomi- 
nantly the significant increase in parental educational attainment 
and the substantial decline in family size. Our pooled regression 
predictions show much larger gains lor blacks than for nonblacks be- 
cause of the larger positive changes experienced by black families. 
The nonpooled regression predictions (that are based on the sepa- 
rate race/ethnicity models) reveal a somewhat different pattern, with 
non-Hispanic whites showing larger gains or similar gains to those 
predicted for blacks. Hispanfcs are predicted to have the smallest 
net gains of the three groups, primarily because of the influx of new 
immigrants, most of whom are less educated and less skilled than 
previous immigrants. Thus, llispanics do not exhibit the large posi- 
tive gains in parental educational attainment and family size experi- 
enced by other groups during this time period and, in addition, suf- 
fered a decline in real income that further reduced the expected gain 
in achievement. 

For at least two reasons, the results of the analysis remain convincing 
despite the simplicity of the linear models and the potential bias in 
the single-parent and working-mother variables. First, when more 
complex models that contain nonlinear and a full range of interac- 
tions terms are used to estimate family effects from 197()/197. r i to 
1990, there are almost no differences in the average predictions from 
these models when compared to the simple linear ones. However, 
we are investigating whether the predictions for youth in muhiplr- 
risk situations change using the complex models. 
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Second, sensitivity analysis shows that our estimates of family effects 
are relatively insensitive to fairly large changes in the size of the 
working-mother and single-parent family coefficients. For instance, 
it would take a coefficient of" approximately one standard deviation 
for single parent to move our family effects by 0.10 of a standard 
deviation, liven for black families, it would take a coefficient of 
approximately 0.60 of" a standard deviation to change the family 
effect by 0.10 of a standard deviation. Coefficients of" this magnitude 
are far outside the range of" any empirical measurements, and even 
simple linear models are highly unlikely to have this degree of bias. 



Chapter Seven 



COMPARING TEST SCORE PREDICTIONS WITH 

NAEP TRENDS 



This chapter compares our predicted test score changes based on 
changes in family and demographic characteristics to actual changes 
reported tor the National Assessment of Educational Progress tests 
given to nationally representative samples of the student population 
at ages 9, 13, and 17 and presents the residual differences that need 
to be explained by factors other than changing family characteristics. 
NAHP trend data on 13-year-olds are compared with the predicted 
trends reported above for the 14-15-year-old NELS sample, and the 
17-year-old NAEP scores are compared with the predicted scores for 
the 15-18-year-old N1.SY sample. Several comparisons spanning 
different time periods are made to see if a broadly consistent pattern 
emerges. NAHP tests were administered approximately every four 
years; comparable reading tests were given in 1971, 1975, 1980, and 
1990, and comparable mathematics tests were given in 1973, 1978, 
1982, and 1990. The 1975 reading tests and the 1978 mathematics 
tests were the first to identify Hispanics as a separate group (U.S. 
Department of Education, 1991). 

COMPARING NAEP DIFFERENCES AND FAMILY/ 
DEMOGRAPHIC EFFECTS 

We look first at trends in the overall population and for iwo racial 
groups — black and nonblack. This allows us to examine trends over 
the longer time period— between 1970 and 1990. We then compare 
our predicted trends for the three racial/ethnic groups to 1975-1990 
reading NAEP changes and 197H- 1990 mathematics NAHP changes. 
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Pooled Sample of All Races 

Figures 7.1 and 7.2 compare the changes in mathematics and ver- 
bal/reading NAEP scores for two time periods for 13- and 17-year-old 
students to the changes predicted based on changing family charac- 
teristics and demographics. For mathematics, family/demographic- 
effects would predict gains that differ from actual gains by at most 
0.15 of a standard deviation (1973-1990 comparison for 17-year-old 
students) but differ from actual gains by less than 0.0B of a standard 
deviation for the other comparisons. The data show that mathemat- 
ics scores must have declined by less than 0.10 of a standard devia- 
tion between 1973 and 1978, since 1973-1990 NAEP differences are 
smaller than 1978-1990 NAEP differences. This is consistent with the 
fact that family/demographic changes would predict gains in this 
time period, since other factors are also operating to change scores. 1 

The reading tests show that NAEP score changes were always loss 
than estimated family/demographic effects for both age groups for 
both time period comparisons. The differences are approximately 
0.10 of a standard deviation. The r - -suits indicate that actual scores 
did not change as much as predicted by family/demographic effects. 
To determine the extent to which the results are different by 
racial/ethnic group, we first present the results lor black and non- 
black groups for the longer time spans, then the 1975-1990 (verbal) 
and 1978-1990 (mathematics) comparisons for blacks, Hispanics, 
and non-Hispanic whites. 

Pooled Sample of Blacks and Nonblacks 

Figures 7.3 and 7.4 compare black and nonblack NAEP scores with 
estimated family effects for 13- and 17-year-olds for 1971-1990 
(verbal/reading) and mathematics (1973-1990). Black students of 



Comparisons between two time periods must lie done with some caution, especially 
il there are large variations in test scoies lor one <n mine veais that do not reflect a 
general trend. As Figure 7. 1 illustrates, there could he some sensitivity of icsulis in the 
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Figure 7.1— Predicted Mean Differences and Actual NAEP Score Differences 
for Two Periods, Mathematics (1973-1990) and Mathematics (1978-1990) 
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Figure 7,2— Predicted Mean Differences and Actual NAKP Score Differences 
for Two Periods, Heading (1971-1990) and Reading (1975-1990) 
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Figure /. 3— Predicted Mean Differences and Actual NAEP Score Differences 
for Black and Nonblack Croups, Mathematics (1973-1990) 
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Figure 7. 1— Predicted Mean Differences and Actual NAFP Score Differences 
for Black and Nonblack Croups, Heading (1 971- 1990) 



137 



Comparing Test Score Predictions with N'AKI' Trends U5 



both ages have made dramatic gains in both reading and mathemat- 
ics scores between the early 1970s and 1990. Black scores have in- 
creased between 0.50 and 0.70 of a standard deviation in this time 
period, whereas scores for nonblacks have either declined slightly 
(0.05 of a standard deviation) or increased slightly. Moreover, 
changes based on estimated family effects for blacks account for less 
than one-half of the total gain. The remaining part of the gain 
presumably might be accounted for by factors outside the family. 

The nonblack comparisons show that family effects were always 
larger than the actual NAHP gains. However, one cause of this may 
be the expanding Hispanic population that is included in the non- 
black sample but cannot be separately identified for this time period. 
Separating out the Hispanic population will allow us to determine if 
the Hispanic gains match the black gains and the extent to which the 
nonblack results are influenced by the Hispanic population. The 
1975-1990 and 1978-1990 comparisons that separate the three 
racial /ethnic groups are discussed in the next subsection. 

Comparing Black, Hispanic, and Non-Hispanic White Results 

Recall that we developed two sets of achievement equations: first, by 
including a set of dummy variables to control for race/ethnicity in 
the model fit to the pooled sample; second, by fitting separate re- 
gressions to each of the three racial/ethnic groups. We showed that 
there was very little difference in predictions based on the two sets of 
models. Here, we show both sets of predictions in the figures below; 
they are labeled "pooled estimates" and "nonpooled estimates," re- 
spectively. 

Math Results. Figures 7.5 and 7.6 show the results for mathematics. 
The mathematics results are fairly similar for both age groups. The 
NAEP results show large gains for both minority groups and small 
gains for non-1 lispanic white students. However, family effects can 
explain less than one-third of the substantial gains for minority stu- 
dents. Family estimates for non-Hispanic whites, on the other hand, 
are very close to the actual gains made. 

Reading Results. Figures 7.7 and 7.fi present the results for reading 
between 1975 and 1990 for Ki- and 1 7 year-olds for the three racial/ 
ethnic groups. The NAF!! 5 scores indicate thai 1 7-year-old blacks and 
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Figure 7.5 — Predicted Mean Differences and Actual NAHI' Score Differences 
for 17-Year-Old Black, Hispanic, and Non-Hispanic White Groups, 
Mathematics (1975-1990) 
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Figure 7.(> — Predicted Mean Differences and Actual NAM' Score Differences 
Tor KiYear-Old Black, Hispanic, and Non-Hispanic White Croups, 
Mathematics (1975-1990) 
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Figure 7.7— Predicted Mean Differences ami Actual N'AKP Score Differences 
for 17-Year-Old Black, Hispanic, and Non-1 lispanic White Groups, 
Reading (1975-1990) 
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1-igure 7,H— Predicted Mean Differences and Actual NAl'.P Score DiUVretu es 
for Y.\ Year Old Black, Hispanic, and Non-Hispanic White (.roups, 
Reading (1975-1990) 
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Ilispanics had large gains of over 0.50 of a standard deviation, 
whereas white scores increased by about 0.10 of a standard 
deviation. Family effects apparently can account for less than one- 
half of the black gains and a much smaller proportion of the Hispanic 
gains. White NAEP gains are somewhat smaller than estimated from 
family effects for reading. The differences are not particularly sensi- 
tive to whether pooled or nonpooled estimates are used. 

Thirteen-year-olds show a similar pattern by race/ethnicity (Figure 
7.8), but the NAEP gains for all groups are significantly smaller than 
for 17-year-old youth — especially among the Hispanic students. The 
non-Hispanic white group again shows a smaller NAFP gain than 
would be predicted by family effects by over 0.10 of a standard de- 
viation. 

THE PATTERN OF RESIDUAL DIFFERENCES BETWEEN 
NAEP SCORES AND FAMILY EFFECTS 

Residual Differences 

Figures 7.9 and 7.10 shows the residual differences between the ac- 
tual NAFP scores and our estimates of family effects for mathematics 
and reading/verbal scores for 13- and 17-year-old youth for each 
racial/ethnic group and the total population. The mathematics re- 
sults show large residual gains for black and I lispanic students of be- 
tween 0.20 and 0.50 of a standard deviation and no residual gain for 
non-Hispanic white students. The verbal results show somewhat 
smaller residual gains for minority students, ranging from approxi- 
mately 0.10 to 0.40 of a standard deviation, but show residual losses 
of between 0.10 and 0.15 of a standard deviation for non-Hispanic 
white students. 

Interpreting the Results 

Hypotheses accounting for the residuals must meet four criteria. 
First, the hypothesized cause must either be empirically finked to test 
scores or at least he plausibly linked to having an influence on test 
scores. Second, the factor must have changed significantly for stu 
dents over this time period. Third, there must be an explanation for 
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Figure 7.9— Residual Differences Between NAF.P and Family Effects on 
Mathematics Test Scores for Different Racial/ Ethnic Groups, 1 978-1990 
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1 i^ure 7.10— Residual Differences Between NAFP and Family Effects on 
Verbal l est Scores for Different Uaeial/Ftlinic Croups, 1975-1990 
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why the factor differentially affected minority scores, Fourth, the 
factor must not be accounted for by changing family characteristics. 
Probably the most plausible candidates for explaining this effect are 
some combination of increased public investment in education and 
social programs and changed social policies aimed at equalizing ed- 
ucational opportunities — such as school desegregation, bilingual 
programs, and programs that increased the opportunity of minorities 
for college admission and jobs. These programs were certainly de- 
signed to encourage and produce higher student achievement. 

Since these programs were primarily implemented in the late 1960s 
and during the 1970s and continued through the 1980s, although at a 
reduced growth rate, they would be expected to primarily affect 
children born and schooled in the 1970s and 1980s. Our compar- 
isons are between children who were either 13 or 17 between 1970 
and 1975 and children who were 13 or 17 in 1990. The first group 
would have been born in the early 1950s to the early 1960s and been 
raised and schooled primarily in the late 1950s and 1960s. So the 
comparison would be between schools and social policies of the late 
1950s and 1960s compared to those of the early 1970s through the 
1980s. 

Fuchs and Reklis (1992) show that public spending on children in- 
cluding education and social programs increased substantially dur- 
ing this period. They estimate that federal, state, and local govern- 
ment per capita spending (in $1988) on children under 18 increased 
from $1300 in 1960 to $2900 in 1988. Thus, in the 1970s and 1980s, 
there was significantly higher public spending per child than in the 
1950s and 1960s. The major portion of this increase is simply higher 
per capita spending on K-12 education. However, the figures also 
include other social programs such as Head Start, food and nutrition 
programs, and others. 

Although it is difficult to determine how these additional funds have 
been targeted, it is plausible to hypothesize that increased public 
spending and changing public policies differentially benefitted low- 
income or minority students. Some programs, such as Title 1, food 
and nutrition programs. Head Start, and bilingual and second- 
language programs were specifically targeted toward lower- income 
or minoriu children. If so. minority stores would lie expected to rise 
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more (ban nonminority scores, since a much greater proportion of 
minority families would be eligible for the programs. 

However, much of the increased spending for children was from 
large increases made in general k-12 school spending. It is difficult 
to determine how this general allocation would benefit different 
kinds of youth. Some additional state funds may have been targeted 
toward schools or school districts with lower-income or minority 
students. However, even with increased funding dispersed widely 
across schools and school districts, it is plausible that a higher pro- 
portion of resources was directed toward low-scoring youth in each 
school or school district. 

Desegregation also may have been an important factor, particularly 
for black students. Desegregation of schools moved a substantial 
proportion of black students into different schools that may have 
been belter funded and more competitive. Since desegregation 
occurred primarily in the late 1960s and 1970s, the two comparison 
groups of black students in our analysis would have probably been 
schooled in very different environments. 

\notlier factor that requires further investigation is changes in stu- 
dent motivation, brought about by a changing job market and higher 
college admissions criteria. Although the job market for young 
workers has deteriorated from 1970 to 1990, especially for high 
school graduates, with a significant decline in entry-level wages, job 
and college opportunities for minorities may have improved relative 
to those for nonminority youth. 

The lack of a residual (mathematics) or a negative residual 
(verbal/reading) for non-Hispanic whites lends itself to several pos- 
sible interpretations that can be addressed with further research. 
One interpretation is that family effects for nonminorities are 
actually smaller than we have estimated with our linear models 
because marginal differences in income, family size, and parental 
education affect higher-scoring \outh less than lower-scoring 
youth.-' 

'\\, It.ai- uin 1 1 1 1 1 v unci ill live mutlrls uiih M|ii,iii'i! iciiiis .i mi used lllctf I'm 
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A second hypothesis is tliat public spending and changed public 
policies simply did not benefit non-Hispanic whites. This might be 
because the most effective policies and programs were those di- 
rected primarily toward racial/ethnic groups (desegregation, affir- 
mative action, bilingual programs, etc.). An alternative explanation 
is that programs that were targeted toward lower-scoring students 
including all racial groups were less effective for non-1 Iispanic white 
students. It should be noted that lower-scoring non-1 Iispanic white 
students are much more often located in rural areas than are lower- 
scoring minority youth. It might be that less attention was given to 
lower-scoring rural youth or that it is just more difficult to help them 
because of their dispersion and isolation. 

A third explanation is that lower-scoring whites benefited from 
public investment but there were more than offsetting losses from 
higher-scoring white youth. Higher-scoring white youth may not 
have gained as much ground as called for by family effects because of 
factors independent of public investment and policies. For instance, 
some have suggested a weakening of the curriculum for higher 
achieving youth (Rock, 1987). There may also have been an implicit 
tradeoff in producing the large gains for minority or lower-scoring 
youth. For example, successfully addressing lower-scoring youth 
may have resulted in less emphasis and fewer resources for higher- 
scoring students. These are all important questions that can be 
explored through future research. 

Finally, the results imply that some factors may explain the residuals 
that are different for mathematics and reading/verbal achievement. 
One possibility is implementation of a new curriculum for 
mathematics that was more effective than the new curriculum for 
reading/verbal skills. Another possibility is differential effects on 
mathematics/verbal skills from factors outside the school. Since 
reading/verbal skills are probably more influenced by factors outside 
school, and mathematics is probably more influenced by vvithin- 
school factors, there may have been differential effects from higher 

laniiiv rllerts. it should he noted th.it the I, truest ch.tni;c is loi non-1 Iispanic white 
students lor reading \erhal srnics when the icsults show a decline in laniilv elleet ol 
f) !!"> ol a sltjiid.il il deflation I his I educes the si /e ol die iu'lialiw iesidii.il somewhat 
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school investments or changes in the nonfamily external environ- 
ment. 

SUMMARY 

The comparisons between NAHP differences and estimated fam- 
ily/demographic effects show that the large minority NAHP gains by 
both 13- and 17-year-old black and Hispanic students cannot be ac- 
counted for by '-hanging family characteristics alone. On the other 
hand, the gains made by non-Hispanic white students can be ac- 
counted for almost entirely by changes in the family. In fact, actual 
gains by non-Hispanic white students in verbal/reading scores are 
lower than would be predicted by family effects. 

We discuss the pattern of these residuals to attempt to identify fac- 
tors that might explain the large residuals for minorities and the lack 
of residual gains by majority students. The pattern is certainly con- 
sistent with the effects that might be expected from changing public 
policies directed at providing equal educational opportunity and in- 
creased level of public investment. 1 lowever, further research is nec- 
essary to better identify the specific factors that might account for 
the pattern of residuals. 
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CONCLUSIONS AND FUTURE RESEARCH 



CONCLUSIONS 

The primary objectives of this study were to analyze the trends in 
mathematics and verbal/reading achievement scores in the period 
1970/75 to 1990 to: 

• Assess the net effect of changing family and demographic 
characteristics on test score trends between 1970/75 and 1990. 

• Compare these family/demographic effects to actual changes in 
scores to determine whether other factors are needed to explain 
score trends. 

• Develop hypotheses that would help explain the pattern of 
residual effects; some likely candidates are changing public poli- 
cies and increased public investment and changes in the quality 
and productivity of schools. 

In terms of student achievement, our estimates do not support the 
commonly held perception that the American family environment 
has deteriorated. Test scores of 14-l!5-ycar-old youth would have 
risen about 0.20 of a standard deviation from the combined effect of 
changes that have occurred in family and demographic characteris- 
tics between 1970 and 1990. The most significant family characteris- 
tics associated with test scores are parental education levels, family 
income, family size, and ago of mother at child's birth. Other things 
equal, higher levels of parental education and family income are as- 
sociated with significantly higher test scores. Smaller family size and 
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older mothers also are associated with higher test scores. The pres- 
ence of a working mother at child's age of 14 is associated with small 
gains in test scores, whereas the variable measuring single-parent 
household — other things equal— has no association with test scores. 

Tor three reasons, our results differ from the "conventional wisdom" 
that the family environment for children has deteriorated over the 
last 20 years. First, two highly significant — but often overlooked — 
changes in family characteristics have had positive effects on test 
scores: the very large increase in parental education levels and the 
significant reduction in family size. 

Second, factors that are popularly associated with a deterioration of 
the family environment — increasing numbers of single-parent 
households and children with working mothers — have much smaller 
effects on test scores — other things equal — than family size and 
parental education level. 

Third, although family income is strongly associated with test scores, 
the average family income has not changed significantly over the 
1970 to 1990 period for families of eighth graders or 15-18-year-old 
children. 

The predicted positive family effects on test scores are largest and 
nearly equal for blacks and non-Hispanic whites, but much smaller 
for Hispanic youth. Although both black and non-1 li '.panic white 
families registered large gains in parental education, reduced family 
size, and stable real family income, Hispanic families shu ved much 
smaller gains in parents' educational attainment, smaller reductions 
in family size, and declines in family income. These differ* -nees are 
probably due to the continuing large immigration of llispa lie fami- 
lies with lower lev els of education and income into the coun ry. 

National mathematics and verbal/reading test scores of representa- 
tive samples of U.S. students aged 13 and 17 have risen over the last 
20 years by about the same magnitude, or slightly U" than the esti- 
mated family/demographic elfects. However, the X,,liP scores dis- 
aggregated by racial/ethnic group show very strong gains for black 
and Hispanic students, and small gains or losses for non-i lispanic 
white youth. Comparisons of our estimated gains by racial/ethnic 
group show that the actual gain in black and Hispanic scores tar ex- 
ceeds the gain predicted from family characteristics alone, family 
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gains account for approximately one-third of the minority gains. For 
non-Hispanic whites, the actual mathematics gains are approxi- 
mately equal to family gains, but family gains slightly exceed actual 
gains in verbal scores. 

The most likely explanation for the gains made by black and His- 
panic students over and above those predicted by family effects is 
changes in public policies and the very large increases in public in- 
vestment in social and educational programs aimed at minorities 
and lower-achieving students. Further research is needed to better 
identify those programs and policies that were effective. 

The lack of residual gains lor non-Hispanic white students also needs 
further research. First, programs designed to aid all lower-income or 
lower-scoring youth may not have been effective for non-Hispanic 
white students. For example, a greater proportion of lower-scor- 
ing/low-income non-Hispanic white youth came from rural areas, 
and the increased dispersion and the absence of economies of scale 
in such areas may have made these programs less effective. Second, 
these programs may have bad an effect on lower-scoring/ lower- in- 
come non-1 lispanic white students but at the expense of offsetting 
declines among higher-scoring students. For instance, it is possible 
that a resource tradeoff existed between low- and high-scoring stu- 
dents that reduced the resources and scores of higher-scoring stu- 
dents while allocating more resources to lower-scoring students, re- 
sulting in large test score gains. 

Our results also suggest that schools attended by 1-1- 18-year-olds in 
HUH) are roughly equivalent to those attended by youth in 1970. 
when considering mathematics and reading/verbal instruction, If 
we assume that constant resources were devoted to mathematics 
and verbal/reading skills, then our results suggest that there were lit- 
tle or no educational productivity gains as measured by mathematics 
and verbal/reading test score trends. However, to fully assess 
changes in school quality and productivity, further work needs to ac- 
count for changes in curriculum, instruction, school climate, and in- 
Mi actional resources. 

When comparing estimated family effects with NAFP scores for the 
vunttger XI I S sample and lor pciiods Irom the late l!)7()s or early 
I'KKK id I'l'ii). the \.\IT gains and estimated lamih ellects shrink in 
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size, although botli remain positive. This might indicate that the 
positive effects stemming from changing family characteristics are 
becoming smaller for younger cohorts during the 1980s. Further re- 
search is being done to see how estimate ! family effects might differ 
for younger children. 

FUTURE RESEARCH 

What Additional Factors Account for Minority (iains in l est 
Scores? 

Two important questions that we will address in future work are: (a) 
What has caused the large gains in minority scores aver and above 
those stemming from changing family characteristics? and lb) Have 
lower-scoring nonminority youth also experienced similar gains? 
These questions are critical to establishing future directions for 
American schools. We are currently conducting research along 
several lines that will help provide answers to these and related 
questions. 

The multiple-risk hypothesis. The child development and more 
clinically oriented literature focuses on the effects of multiple-risk 
factors on children. The underlying hypothesis implies that test 
scores might fall dramatically (nonlinearly or exponentially) when 
children are under conditions of multiple risk. Basically, this means 
that the effects on test cores of having low family income and low 
levels of parental education are worse than the additive effects of 
each factor independently. One can regard this as a sort of a slippery 
slope where student achievement falls drastically with every new risk 
added to the child's life. However, as risks decline, student achieve- 
ment should go up dramatically as well. Models incorporating the 
multiple-risk concept may help explain the rapid gains in the test 
scores of minority students. 

Our analysis shows that the pii,-.iar\ cognitive family risks include 
being born to a teenage mother, being in a low-income household, 
having parents with low educational attainment, and being in a large 
family. We are currently developing more sophisticated models that 
incorporate the concept of multiple risk. 
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Changes in school environment. Our analysis is limited to the 
effects of family factors on student achievement. However, if 
changes in school characteristics are associated with improved 
scores, and if the school environment facing minorities, particularly 
blacks, has improved over time, then this may help explain the large 
minority gains in achievement. Some evid?nce exists to show that 
school characteristics do affect test scores o r minorities. Moreover, 
the school environment for black children certainly changed dramat- 
ically over the past 20 years, with increased desegregation, net mi- 
gration from the south, and increased spending on education. These 
changes may have produced better school environments and may 
have helped foster the academic achievement gains. 

Other factors. Another possible explanation for minority test score 
gains may be changes in student motivation. There is evidence to 
suggest that the proximal home environment — in terms of emphasis 
on learning, amount of time spent on homework, and high parental 
expectations— can significantly affect student achievement. The key 
question is whether there were differential changes in minority stu- 
dent motivation occurring during this time period. Although this is a 
difficult question to answer because student motivation is difficult to 
quantify, we can suggest some factors that may have had a favorable 
effect on minority student motivation. For example, blacks began to 
have access to better and more competitive classrooms as a result of 
integration, there were increased opportunities for college for both 
children and parents, and this undoubtedly led to higher parental 
expectations for children's achievement. In addition, the economic 
literature suggests that, at this time, blacks faced increased returns to 
education compared to whites; this may have increased expectations 
and the desire to stay in and do well in school. 

Developing Better Indicators of At-Risk Children 

Several federal and state policies are directed toward at-risk children. 
These polic ies use a variety of measures to define at-risk populations 
but usually depend on one or two measures with somewhat arbitrary 
cutoffs. Many additional risk factors (other than those incorporated 
in the family models! need to lie identified. Models based on more 
inclusive cognitive risk factors ran help provide a better basis for 
identifying populations ol at-risk children and for estimating 
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changes in the size and location of these populations. In the longer 
run, we need to develop a framework that allows comparisons of the 
incidence of risk, the populations at risk, the effectiveness of pro- 
grams to alleviate risks, and the costs of such programs. Such analy- 
ses need to be done for different populations of at-risk children, 
since there will he differences across risks and types of children in 
what is effective. 

Effects on Younger Children 

Our analysis focuses on changes in families with children between 
the ages of 14 and IB between 1970 and 1990. Some believe that the 
family environment may have worsened for younger children, par- 
ticularly during the last ten years, so if we duplicated our analysis for 
H-l 8-year-olds in the year 2000, our results may be different. To 
test this hypothesis, our methodology can be used to study younger 
children and more recent trends. 
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DERIVING SHIFTS IN TEST SCORES FROM CHANGING 
FAMILY CHARACTERISTICS AND DEMOGRAPHIC 

COMPOSITION 



Under ideal conditions, datasets would be available at two times for 
representative groups of similarly aged youth that contain both test 
scores and the important variables that determine test scores. If we 
have two representative samples of students at lime t\ and t->, then 
test scores are given by: 




(1) 



II ' 111 



(2) 



where 



test score for student / at time /, 



X 



family characteristics and demographic variables for 
student / at time /, 



) 



in 



school, community, and other nonl'amih variables 
for student jnl time /, 



' ;/ ,.' - linear regression coefficients. 



The shift in the mean test score can be estimated as: 
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shift in family or demographic characteristics, 
shift in nonfamily characteristics, 

average of family coefficients, 

average of nonfamily coefficients, 

change in family coelficients, 
change in nonfamily coefficients. 

The first term is the shift in the intercept term that is unrelated to 
changes in family or demographic composition. The second term is 
the estimated mean shift in test scores resulting from changes in 
family characteristics and demographic composition. The third term 
accounts for shifts in nonfamily variables. We are trying to estimate' 
onh the shift resulting from family and demogiaphic composition. 
This is given h\ : 

•V/um - illU'A * X lt \h„\ 

n 

Since we estimate nils the equations with the family and demo- 
graphic variables, we, of course, assume that the coefficients of fam- 
ily and demographic variables are independent of, anil not biased by, 
the exclusion of the other variables from our equations. 1 

There are two terms in this equation. The first corresponds to the di- 
rect shift resulting from changes in family and demographic com- 

'We li.nc dune lutthei cMihmlian with the \l Is vmiplc ulmh itnltn' "s v»ni;iliti»> 
niiu".|>(iinliii); in st In ml, i m i it n tn tit v .iiul |i.iifiiini|: \ .n i.il'lrv ,oitI ilu- < fi.utj^i'- hi llu- 
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position, liolding the coefficients constant. The second term repre- 
sents the effect of structural shifts in coefficients, holding family and 
demographic composition constant. For instance, the effect of fam- 
ily income on test scores may shift over time. These structural shifts 
can be caused by cultural and policy changes affecting families but 
not by simple changes in family and demographic composition, as- 
suming linearity. 

Since we do not have samples of similarly aged children at two times, 
we cannot estimate with our data the structural shifts in coefficients. 
The structural coefficients would be expected to be functions of the 
age of the children, so the difference in coefficients we find between 
•he NF.I.S and NLSV cannot be attributed only to structural shifts in 
coefficients. 

In our estimates we thus treat the NFl.S and NLSY estimates as sim- 
ply independent estimates of the mean structural coefficient for each 
age group and make estimates of mean shifts in test scores for each 
age group, using the NLSY and NKLS equations, Assuming that no 
structural shifts in coefficients have occurred over the 1970-1990 
time period of our measurements, our results will accurately mea- 
sure the effect of family and demographic composition shifts. 

If shifts in coefficients are occurring, the bias in our measurements 
will be small if: 

v.Y M .\fi (l v/7.vY, ( 
// // 

II changes in coefficients simply relied offsetting shifts among coef- 
ficients, bias from changes might he small even though large shifts 
occur in individual coefficients. For instance, we find that the NF.LS 
results have stronger education effects but weaker income effects 
compared lo those of the XI.SY. Such shifts can be partiallv 
offsetting. 
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PROFILE OF FAMILIES OF 14-15-YEAR-OLD 

YOUTH 
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Table B.2 

Profile of Black and. N'onblack 1 4-1 5- Year-Olds, 1970-1990 
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Table B.3 

Profile of Hispanic 14- 15 -Year-Olds, 1975-1990 
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WEIGHTED AND UNWEIGHTED REGRESSION 

RESULTS 
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